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ABSTRACT , . 

The purpose of this book is to - provide a 
comprehensive summary of current information on describing writing ^ 
and measuring growth in writing, intended to help teachers decide 
Which aspects Qf the process and th€ product to examine, hov to 
^determine a writer's specific instructional needs, how to measure 
/growth in writing ability, and how to involve students in the 
/evaluation of writing. Separate articles discuss the following 
'topics: various approaches to holistic ^evaluation, with particular 
^a^btentidn to analytic scales; a new holistic scoring procedure, 
. Primary Trait Scoring, developed for use in a nation-wide assessment 
/ of writing performance; ways in which the computer can be used to^ 
^ characterize maturity of word choice in students* papers; new and'^ 
unpublished research that affirms earlier finditg^ by Kellogg Hunt 
and Francis Christensen about the development of syntactic fluency in^ 
school-age writers; a procedure for identifying the basic / 
intellectual strategies writers use in formulating and presenting . 
their ideas and feelings; *and thtjee ways to involve students in * ^ 
evaluation — individualized goal setting, se^f-evaluation, and peer 
.evaluation. (GH) 
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The purpose of this book is to provide a comprehensive summary of the 
besTcufrent information oh describing writing and measuring growth in 
writing. The authors have tried to keep in mind the concerns of research;^ 
ers and curriculum evaluators and of teachers in secondary schio(^s^ria 
colleges. We hope the information we present here will help solve some 
of the complex and perplexing problems o£ evaluating the writing perfor- 
mance of secondary school and college students. 

Early drafts of each chapter were prepared as papers for the Confer- 
.ence on Describing Writing and Measuring Growth in Writing held prior 
to the 1975 San Diego Aimual Convention pf the National Council of 
Teachers of English. The conference was planned and cochaired by the 
' editors of this book. ! 

At the conference and later in revising the papers, v/e attempted to 
answer these questions: 

. 1 When we describe writing and measure students* growth in writing, 
what should we look at? Should we examine only the written pro- 
duct? Should we examine the processes or strategies which generat- 
ed that product? In either case, what facets of ffie* product, what 
aspects of the process should we examine when we describe/mea- 
s\ire so complex a thing as growth in writing? J 

2 How can we find out how well an individual performs at a certain 
stage in his or her development as a writer? To ask it another way: 
Row can we determine precisely what a writer is doing and not 
doing so that we can plan efficient, focused instruction? 

3 How can we measure growth in writing ability over a period of 
time? 

4 ' How can we involve students in the evaluation of writing? 
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viii ' ^ • Introduction 

As a result of recent developments in theory and research findings, we 
discovered that we could answer these questions Nvith some confidence. 
We knew at the putset that we wer^linwilling to settle for the kinds of 
information provided by published standardized tests of writing because 
wejdid-not believe they assessed students* ability to compose for different 
purposes and audiences: During our interactions at the conference, and 
later in revising our papers, we were relieved and pleased to be able to 
a£Bmi that valid evaluations of writing performance are possible. Such 
evaluations are tiine-consuming; but for reasons we shall explain, they are 
greatly preferable to standardized tests that purport to measure writing 
ability. "i 

The specific contributions of the authors follow: 

• Charles Cooper reviews various approaches to holistic evaluation, 
giving particular attention to analytic scales. 

• Richard Lloyd-Jones presents a promising new holistic scoring 
procedure, Pjmiary Trait Scoring, which was developed for use in a. 
nation-wide assessment of writing performance. - 1 

• Patrick Finn describes how the computer cap be used t9 cnaracter- 
ize maturity of word choice in students' papers and mcidentally 
raises a number of interesting questions about word choiice. 

m Kellogg Huntlreviews some new and unpublished research t|iat af- 
firms his and Francis Christ ensens earlier findings about the devel- 
opment of syntactic fluency in school-age writers. ' 

• Lee Odell Qutlines a procedure for identifying the basic intellectual 
strategies writers use in formulating and presenting their ideas and 

. feelings. . | 

. • Mary Beaven presents a careful critique of three ways to involve 
students in evaluating: individualized goal setting, self-evaluation, 

and peer evaluation. ' . - r "' 

Conspicuously absent from this list of articles is any extended discus- 
sion of st^datdized tests of writing. Although widely used, standardized 
tests measure only ejditorial skills— choosing the best sentence, recogniz- 
ing correct usage, punctuation,.and capitalization. At least for this reason, 
tests are not valid measures of writing performance. The only justifiable 
uses for stey^dardized, nonfn-ref^renced tests of editorial skills ar(fe for pre- 
diction or placement or for the criterion measure in a research study with 
a narrow "correctness" hypothesis. But even their use for placement is not 
as valid as a single writing sample quickly scored by trained raters, as in 
the screening for Subject A classes (remedial writing) at the University of 
California campuses. In instances where a writing sample is impossible to 
obtain for tentative placement or exemption, we would prefer a simple 
verbal ability measure like the Scholastic Aptitude Test verbal section 
over a standardi7,ed test of editorial skills. 



IntrodpicHon ' , ^ ' ^ 

Many of the descriptive procedures and measures described in tlie 
chapters in this book Will yield scores that^^can be treated just like the 
scores obtained from standardized tests, but they are more valid in that 
they are based on actual pieces of writing, on some \yriter s real perfor- 
mance, r—-^ — ' — 

In deciding how to. use these procedures and measures, one must have a 
comprehensive view of the various us^.of evaluations and an understand- 
ing ot^certain important .terms: writing products, writing proce$Sy 'reliab& 
ittfy and validity. 

Writing evaluations have at least these uses: 

Administrative 

1 Predicting students' grades in English courses. 

2 Placing or tracking students or exempting them from English 
. courses. ; 

3 Assigning public letter or number grades to particular pieces of . 
writing and to students' work in an English course. 

Instructional 

4 Making an initial diagnosis of students' writing problems. 

5 Puiding and focusing feedback to student writers as they progress 
through an English course*,.. • ^ 

Eviiluation (^d Research ' . 

* 6 Measuring students' growth as >yriters over a specific time period. 

7 Determining the effectiveness of a writing program or a writing 
. teacher. , y} 

8 Measuring group differences in Writing performance in bom- 
parison-group research. 

9 Analyzing the performaiiCjB of a writer chosen for, a tase study. 

10 Describing the vmting performance of individuals or groups in 
developmental studies, either cross-sectional or longitudinal in de- 
sign. 

1 1 Scoring writing in order to study possible correlates of writing per- 
formance. ^ / , ^ 

Some of the measures described in this book will sei ve several of these 
uses, but some have quite limited and particular uses. For example, the 
most efficient measure for prediction or placement may not be the best 
measure for growth. The best measures for diagnosing a writer s perfor- 
mance at the beginning of a course will not necessarily be the best for 
determining amount of growth during the course, although the two sets of 
measures might overlap. Consequently, we think it is critical for teachers, 
researchers,, and curriculum evaluatbrs to knojk why they are evaluating 
before they choose nieasuries and procedure^. 
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"^'^ Finally, we would like to offer jSefinitlons of the crucial terms for dis- 
cussing evaluation. \ 

Writing Products. Writing occurs in many different forms. Further, 
pieces in the same form can have quite different purposes or audiences, 
and the writer can be using different pei^onae. When we talk about teach- 
ing writing or describing writing, we have to^be very careful to include in 
writing all kinds of writjlng that . people do out there in the world, not just 
the one ojr^o kinds which' are of traditional interest in secondary schools 
or colleges, like the essay about the literary work or the five^arajjraph 
theme. By U)riting we mean^at lea$t the following kinds of written dis- 
course: ^ 

; dramatic writing ... . ' * • 

dialogues, scenes, short, plays * \ 

Spcratic dialogue ' ^ 

dramatic monologue ^ * 

' interior monologue 

sensory recording 

reporting ? ^ ^ 

observational visit * ' * 

interview 

^ reporter-at-large * 
v case study 

proiile, 
generalizing and theorizing 

essay about the literary work <> 

expository essay on firsthand or researched information 
' ^ - rejsearch 

(from lower-order, primary documents; not from textbooks, 

summary articles, or encyclopedias) , * 

pe^rsonal writing 

journal, diary, log 
. commonplace book 

personal letter 

autobiography . ' 

firsthand biography 

firsthand chronicle 
poetry 
prose fiction 
business/practical 

personal resume and job application 

forms 

technical reports 

giving instructions y 
explaining a process. /' 
memo ^ / 
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business letter" 

eommunioUing technical information 

requesting information 
. transmitting a report 

Writing Procex^.'Composing involves exploring and mulling over a sub- 
ject; planning the particular piece (with or^ithout hptes or outline); get- 
ting started; making discoveries about feelings, values, or ideas, even 
while in the process of writing a draft; making continuous decisions about 
diction, syntax, and rhetoric in relation to the intended meaning and to the 
meaning taking shape; reviewing what has accumulated, and anticipating 
anti rehearsing what comes next; tinkering and refonnulating; stopping; 
contemplating the finished piece and perhaps, finally, reVisin^. This com- 
plex, unpredictable, dertianding activity is what we call the writing pro- 
cess. Engaging in it, we learn and grow. Measurement plans for instruc- 
tion or research should not subvert it. - • 

Reliability: 'U a measure or measurement scheme is reliable, it is fair to 
writers, permitting them to demonstrate what they can really dq. For pur- 
poses of a quick tentative screening or placement decision, we heed 6nly 
ksk a writer for one piece produced under the best conditions We can 
^ange. However, from previous research \yektiow that either a-compre- 
hensive description of writing performan^ceqjr_a.reliable.taid;.ordering_of 
a group of Writers can be achieved only by asking for more than one pi^e 
of writing on more than one occasion and then involving two or more 
.people in describing or I'ating each piece. Even iKen, we have reliable 
measurement^of writing ability in only one mode.' To test ability to write 
^n different modes (personal narrative, explanation, dramatic dialogue, 
reportage, prbse Action) or to write for different purposes (explanation, 
persuasion, e?c?r^sidh), we need njultjple pieces on multiple occasions. 
As an examdl^ we know from previous research that syntactic patterns 
vary from mocle to mode, and furtHer, that the best writers display the 
most variation. t ^ • 

Validity: If a measure or measurfemqit scheme is valid, it does what we 
say it is doing. We want to insist on a careful distinction between predic- 
tive validity and two other kinds of validity, content jand construct validi- 
ty. If a measure has predictive validity, then it pr^cts performance at 
some time in the future or it correlates well witJi some criterion, say 
grades earned in English, or it permits an approximate grouping or place- 
ment. If a measure has content validity, then it is an appropriate measure 
for a particular writing program. It actually me^ures whatwitiersJia^^ 
been practicing in a course or program. If a measurelja^^ validi- 
ty, then it actually measures the const?iicti>t4nter^in this case, writing 
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iMlity or \y«ting performance. We assume that teachers and researchers 
a>^\prifnarUy^^ with content and construct validity. Predictive 

valimty is of ii^terest primarily to makers;of standardized tests. 

AbW contertt validity we ask: Does a given measurement scheme Real- 
ly permit vmters^to dencionstrate what they have achieved in a course * 
^ program? \^ " . / ' 

About constnict^ralidfty we ask: Does a given nieasureraienflchpme,,,..^^ 
yeally permit a description of writing or the use of writing strategies?1[s 
the scheme faithful to our best current information about the writing pro- 
cess, the writers strategies, and.the-universe of %yritjen discpdrse? 
We want to conclude by insisting that .there is no mechanical or techni- 
- cal. solution to the problems posedjn ^aluating writing. Since wri^g is 
an^exmi^sive hunian activity, ,we believe the best response to it is a rectep- 
tive,-^pathetic human response. We believe that each chapter in thi^ 
book contributes to making that human response more insfghtful, more * 
focused, more helpful. I \^ 

Charles R. Cooper and Lee Odell 
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In devising ways to measure students* growth in writing, we continually 
struggle with two problems: making judgments that are reliable, that we 
can reasonably assume are not idiosyncratic; and making judgments that 
are valid, that provide significant information about the \vriting we are 
dealing with. Hplistic evaluation can offer a solution to both problems. 
There are, as Cooper points out in the following chapter, limits to the. 
ways we can use some holistic procedures. Not all of them result in the 
sprt of detailed description that we need for diagnosmg students* writing 
problems. In addition, devising and using holistic evaluation procedures 
takes a good degl of time and effort. These limitations apart, however, it is 
..possible to use pxisting procedures to conduct resejurch or school-wide 
evaluation projects ajid to provide .summative evaluations of students* 
w/iting.^ Moreover, as Cooper illustrates, it is possible for teachers in 
ijiven school to devis.e reliable, valid holistic procedures that are uniquely 
suited their own schools writing program. 



y 



TTOLISTIC EVALUATION 
/ OF WRITING 



Charles R. Cooper 



\ * Introduction- ' _ ^ 

Holistic evaluation of writing is a guided procedure for sorting or ranking 
written pieces. The rater takes a pieccpf writjhg and either (1) matches it 
with another piece in a graded series of pieces or (2) scores it for the 
prominence of certain-^features important to that kind of writing or {3) 
assigns it a letter or number grade * The plading, scoring, or grading occurs 
quickly, impressionistically, after the r^ter has practiced the procedure 
with other raters. The rater does not make corrections or revisions in the 
paper. Holistic^^ evaluation is usually guided by a holistic scoring guide 
which descrilJes each f eatiire and identifies high, middle, and low quality 
levels for each feature, , • / 

.,tWhere* there is commitment and time to do the work required to 
achieve reliability of judgment, holistic evaluation of writing remains the 
most valid and direct means of rank-ordering students i>>^ writing ability. 
Spending no more than^ two minutes on each paper, rat^, guided by 
some of the holistic scoring guides I will describe here, can achieve a, . 
scoring reliability as high as .90 for individual writers. The scores provide 
a reliable rank-ordering of writers, an ordering which can then be used to * 
make decisions about placement, special instruction, graduation, or grad- 
.ing. ^ • ' ' *^ . ^ 

For researchers and for state and national assessors, the possibilities in 

" holistic evaluation are a reminder that they need not settle for frequency 
counts of word or sentence elements or for machine-scorable objective 

; tests. Apiece of writing communicates a whole message v^dth a particular 
tone to a known audience for some purpose: information, argument, 
amusement, ridicule, titillation..At present, holistic evaluation by a human 
respondent gets us closer to what is essential in such a communication 
than frequency, counts do. 

■ ' f ■ y ' .- 
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Since holistic evaluation can be as reliable as multiple-choice testing 
and since it is always more valid^ it should h^e>6rst daim on our attention 
when we need scores to rank-order a ^up orsfuaents. , 

I r* , . — = u 

\ 

Overview of Various Types, of Holistic Evaluation 

Included here are brief descriptic^ns of seven types of holistic evalua- 
tion: ess^y scale, analytic scale, dichotomous scale, feature analysis, pri- 
mary trait scoring, general impressior^ marking, and **centCT 6f gravity*' 
r^pohse. Following these, I will focus On analytic scales, describing how 
^they are\constructed, presenting two in their entirety, and exploring their 

US^.X^\ / \ * . . 

As my examples of holistic evaluation will illustrate, I am using the term 
"holistic" tO:mean any procedure which stops short of enumerating lin-- 
guistic, rhetorical, or informational featiures of a piece of writing. Some 
holistic procedures may specify a number of particular features and even 
require that, each feature be scored separately, but the reader is never 
required to stop and count or tally inddents of the feature. The reader 
uses the list of features only as a general guide-^a set of reminders, a way 
of. focusing— in reaching a holistiq judgment. Readers who are familiar 
with the procedures used by the College Entrance Examination Board to 
score essays from the English CompositioA^est and Advance Placement 
Test in English Ayill recogiiize that I am attempting to broaden soi^iewhat 
the way we use the term "holistic." In the next 'diapter Lloyd-Jones labels 
as "atomistic" at least some^pf the types oiF holistic evaluation I describe 
below. Some uncertainty about terminology seeihs^ quite natural in an 
area in which tl:3 eai ly research and field work has been^o^iincoo;:^ated 
and in which we ha\ e not reached wide agreement On standardTprOce- 
dures. ' ^ v x 

Essay Scale . \ 

The essay scale is a series of complete pieces arranged according to^ 
quality. At one end of the series is an exemplary piece, at the other an 
inadequate one. The pieces which make up ihe scale are lUftialiy selected ^ 
from large numbers of pieces written by students like those Nvith whom 
the scale will be used. A rater attempts to place a new piece-of writing 
along the scale, matching it with the scale piece most like it. 
' Perhaps the best-known essay scale in this country is one developed by 
a commfittee of the California Association of Teachen of English (Nail et 
al. 1960; and in Judine 1965) and now distributed by the National Council 
of Teachers of English. It was developed from an analysis and sorting of 
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561 essays written in California grade 12 classrooms on one of ten topics. 
Th^.six papors in the published scale are on th^ topics juvenile delinquen- 
cy ,-dutdoor litter, rural life, and a favorite sphool subject. Each essay has 
been^narked with correction symbols and with a few marginal notes. 
Follo^ng each essay is a **critical comment." 

Anotfier essay scale, Assessing Compositions (Martin et al. 1965), was 
developed by a committee of the London Association for the Teaching of 
English. It should be much better known than it is, although it, too, was 
distributed until recently by the National CouiiCil of Teachers of English, 
Presently, it is available only from the British publisher Blackie. Since it is 
a particplarly sophisticated example of an essay scale, it deserves some 
detailed^ attention here. ^< . 

*While[the California scale was developed for expository wilting, the 
London ^scale was developed for "imaginative" writing from pieces writ- 
ten by fifteen-year-olds. The committee set one topic, Vilone," for a num- 
ber of students in eight schools, but then filled out the final scale with 
pieces on other topics produced by the students in^the regular writing- 
program at the schools. Other tgpics are^*Saying Goodbye," "CaniiM^g," 
l"My Family," "A Walk Along the Cliff One Winter s Day at Sunset," "My; 
First Dance " "My First Pop Performance," and "Our First Job." Alto^ 
gether, the London scale includes twenty-eight pieces in groups of five to 
seven pieces of equivalent quality, with two additional outstanding 
pieces. ^ 

As .the committee read and reread' the pieces, they found ^hey y^ere 
;4ising answers to the following questions to explain their general impres- 
sions of the quality of the pieces: 

1 Does th^ experience seem real? Is there diversity of information in 
the detail, and is it relevant to the experience? Do the details show 
that the writer is recreating a^;experiehce or are they clich&r / 

2 l^s something been made of the experience so that it^has sigri^- 
cance for writer and reader? Is the work structured? There may be 
a simple change of pace. There may be a sense of coming to the 
point in the njarative for which all before has prepared, and on 
which all that follows reflects. / ' 

3 Is the vocabulary precise and, where necessary, rich in associations? 
Is there sufficient variety and complexity of sentence structure to 
permit more complexity-of-subject, deeper understanding?-ls"the 
language being used in a personally creative way , or does one word 
so determine the next that there are only clich^ of thought, feeling, 
and language? 

4 Is there adequate control of spelling and punctuation^so that the 
.writer manages to communicate, and manages to do so without irri- 
tating the reader too much? • 
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^' These questions suggest the possibility that the work being done on 
hgjistic evaluation can be useful to teachers and students who see the'need. 
for ways to guide and focus feedback in personal conferences or small- 
group. writing workshops;- 

The main criteria for the grouping and ranking of the twenty-eight ima- 
ginative pieces of the London scale were; . \ 

1 ^ Realization; the extent to' which the writing directly refljects the wri-' 

ters own experience (sitjcerity, spontaneity, vividness). ' ' * 

2 Comprehension: the extent to which a piece of writirig shows an 
awareness of audience and can thereby be understood^ permitting 
some concensus of response. 1 , ; 

3 Organization: the extent to which a piece of writing has shape or. , 
coherence. - i - ^ 

4 Density of Information: the amount of unique and significant detail. 

5 Control of Written Language: extent of control over the special 
forms and patterns of written syntax and rhetoric. 

The pieces are presented without critical marking or annotation. In a 
separate section of the pamphlet, each essay is discussed briefly in terms 
of the questions, and criteria listed above. The discussions seem to me 
especially insightful in a number of ways, particularly in distinguishing 
between mere technical competence and effective communication. The 
raters have this to say about one essay: "The apparent competence of this 
essay masks its emptiness as a piece of writing . . . although there is.an _ 
.attempt at organization here, it is external to the meaning or experience of 
the [topic]. . . . The writer has not concentrated on the subject and its 
meaning but on performing a series of linguistic exercises whose connec- ^ 
tion with the subject is tenuo\is. . .\ We think this notion of what good 
writing is can only hinder the development of cbilJren s ability to use the 
written language effectively." , * , 

Still another scale — and one designed for a purpose different from that 
of the California or London scales— is the Smith scale (V. Smith 1969). It 
assesses the accuracy of teacher Jydgment of elementary school writing. 
Teachers are given a set of five Brief letters to a pen pal and asked to 
identify the fwo best and two worst. Scoring is based on the extent of 
teacher agreement with experts' rankings of the letters. Although Smith 
recommends the scale for acquainting teachers with the accuracy of their 
judgments and for screening coniposition raters in evaluation or research 
studies, a stud> b> W'halen (1972) suggests the scale may be invalid for 
those purposes. At an> rate, the Smith study does demonstrate another 
potential use for essay scales— measuring teacher agreement with experts 
and screening raters— and incidentally suggests a way to derive a scori? 
^ from such a scale. 
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. Essay scales, then^ have a number of uses. They can show studeiit wri; \ 
ters a range of quality for one particular writing task or writing mode; foe: 
example, the teacher could use a scale of five to eight pieces as th^ basis 
for a. class discussion. An essay^cal^^could be used to acquaint teachers- 
in-trainirtg with the range of \<-ritirvg qualit> at a particular grade level. In 
order to determine the range ^f writing abilities and as a basis fdr dijcuss- 
ing the writing program,^ teachers in a school Or at a particular graddlevel , 
could cooperatively develop ^ scale, I wouia recommend that teachers 
"develop. a separate scale for each o'f the major types of Writing in the 
writing program: explanation^ personal narrative, reportage, prose fic- 
tion, to. mention just four possibilities. Still another use for an essay scale is 
to set a standard, to draw a line of adequacy/ indicating that all essays 
above some point on the scale rwould be acceptable in a college course, 
for high school graduation, fot^a "C" grade in a course, or for some other 
purpose. 

.During the 1920s ancl 1930s, bssay scales were widely used by teachers 
and researchers (Braddock, Lloyd-Jones, and Schoer 1963), but I know of 
,only one recent, instance where an essay scale has been used as the 
writing-quality criterion measure in <in cxperinicntai intervention study 
(Sanders and Littlefield 1975). As we shall see, other holistic schemes are 
more efficient and almost certainly more reliable. 

Analytic Scale 

An analytic scale, the ho^^ic evaluation device of particular interest in 
this chapter,^ IS a list of the prominent features or characteristics of writ- 
ing in a particular mode. The list of features ordinarily ranges fronri four 
to ten or twelve, with each feature described in some detail anj^^with 
high-mid-low points identified and described along a «jcoring line for eaeli 
featufe. Sometimes the high-mid-lou points are exemplified with com- 
plete pieces of writing in the manner of an abbreviated essay scale. 

To illustrate, here is a well-known scale (Diederich 1974) developed 
from an anal> sij> (itiicademics* and nonacadcinics* judgments of theSvrit- 
ing of collegeTreslunen, 

Low i Middle * High 

General Merit 

Id^tas 2 f 0 S 10 
Orgaiiizatioii 2 4 6 8 10 
Wording \ . 
. Flavor 1 2 3 4 o 

Mechanics \ 
Usage 1 3 4 



Punctuutioii 1 2 3 4 o 

Spelling 1 2 3 4 5 

Handwriting 1 2 3 4 5 

Total 
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. The doubled valuer assigned to "ideas" and "organization". reflect the 
emphasis in the writing programs in thjg schools where the scale was in- 
itially used. The complete scale describes in a general way the high-mid- 
low points along each featme scoring line' as in the "following description 
for "ideas": . 

High. The student has given sorpt^ought to the topic and ' 
writes what he really thinkj^-rie discusses each main point 
long enough to show clearly what he means. He supports 
each niain point with arguments, examples, or details; he 
gives thetreader som^ reason for believing it. His points 
are clearly related to the topic and to the main idea or im- 
pression he is trying ta convey. No necessary points are 
overlooked and^here is no padding. ^ * / 

Middle. Thj^paper gives the impressioi) that the stufent ^ 
does not jeally believe what he is writing or does not fully 
understand what it means* He tries to guess what the 
teachl^ wants, and writes what' he thinks will get by. He 
does ^ot explain his points very clearly or^niake them 
come alive.ta the reader. He writes what*'fie thinks will 
sound good, not what he believes or^Imows. ' 
Low. It is either hard to tell what^oints the student is try- 
ing to make or else they silly that, if he had only 
stopped to think, he would have realized that they made 
no sense. He is only^ing to get something down on pa- 
per. He does-rtot explain his points; lie only asserts them 
and then goes on to sonnething else, or he repeats theni in 
slightly different words. He does not bother to check his 
\^ facts, and much of what he writes is obviously untrue. No 

one believes this sort of wTiting— riot even the s'tudent who 
wrote it." ' 

Readers learn to use-tjie scale by studying the descriptions of high-mid- 
low values for each feature, trying the scale on pieces of student writing, 
and discussing the results. 

I am merely introducing the analytic scale briefly in order to place it in 
the cdntext of my overview of kinds of holistic evaluation. We will see 
later how analytic scales may be constructed, how they can provide reli- . 
able scores for placement or summative evaluation, and how they can be 
used to guid^ formative evaluation. ^ 

Dicl^tomous Scale ^ ^ • - 

A ^iphotomous scale is a series of statements which can be answered 

yes or ifo. Instead of deciding on a score.along a scoring line of five or ten . 

4i 
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points, as with ^tllfc^analy tic scale, the rater simply decidesNvhether the 
piece has the feature identified in the statement. Her<? is an example from, 
a study of the eflRectiyeness of community college writing programs. Th^ 
stale was developed by the teachers participating in the shidy (Cohen, 



Score Sheet 



Yes 



No 



Ck)ntent I. 



(X^ganization II. 



Mechanics'^ III. 



1. Ideas themselves ar4 insightful. 

2. Jdeas are creative or original. 

3. Ideas are^ rational or logical. 

4. Jdeas are expressed with clarity. 
^ 5. There is a thesis. 

6. Order of .^thesis idea is followed 
throughout the ^ay. 

7. Thesis is ade^iuately developed. 

8. E\ery paragraph is relevant to the 
thesis. , 

9. Each paragraph has a controlling 
idea. I 

10. Each paragraph is developed with 
relevant and concrete details. 

11. The deUub that are included are 
^eU ordered. 

12. There are many misspellings. 

13. There are serious puncjtuation 
errors. 

14. Punctuation errors are excessive. 

15. There are errors in the use of verbs. 
IB. There are errors in use of pronouns.- 

17. There are errors in use pf modifiers. . 

18. There are distracting errors in 
word usiage. 

19. The sentences are awkward. 



'The group results from the study in which the scale was used demon- 
stTAte^d both that the writing programs in several colleges were having 
some^ effect .on iting performance and that the placerfient*of stud^ts 
into "remedial and regular classes was .reasonably accurate. No cdxvjfen* 
tional reliability data are reported for the*scale, since it-^M^asiaot Jfdng 
used ^ score individuals but orAy, to compare groug^erfprmanc^ on a 
single pre- and posttest essay. The percentage o^^ncurrericaaraong all 
the raters on four essaysdistriButed solely to gather reliability data ^nged, 
from .50 (a. chance scOfe on a' dichotomou^ triable) to 1.00, butt ipost o( 
the percentages of concurrence for thp nineteen items in the scalewere in 
the seventies and eighti^^^ ^/"^ . ' % • * */ 

r doubt whether dichotomojus scales would yield reliable scores on indi- 
viduals, but for 'making gross distinctions between the quality of batches 
of essays, they seem quite promising, though apparently requuring no less 
time to use than an analytic scale for the same purpose. - 
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Feature Analysis 

Analytic an^ dichotomous scales are ordinarily quite comprehensive, 
attempting to direct the rater to several features in a piece of wnting. By 
contrast, feature analysis focuses on a particular aspect of a piece, per- 
haps its structure. The cne example I have of this type of holistic evalua- 
tion is an instrument de^ ^eloped by Stahl (1974) to describe the structural 
features of children s and adolescents* descriptions of their homes. It 
could probiibly be used with other descriptive writing tasks. No reliabili- 
ty data are included in the report.; 

I The instnument has ni le categories: indicated order, principle of selec- 
tion, methods of arraiigt ment, syoitax, balance, organization, connectives, 
openings, and conclusio i. Each^f these categories can be scored for five 
types of structure. Let r le illustrate by pr^esenting here the complete de- 
scription of the categor}^ methods of arrangement, which deals with "the 
manner in which the contents of the composition are arranged." The five 
types of structure for thi ; category are arranged from most t|) least sophis- 
ticated. " * ' 

Comprehensive. Explicit division of the rooms in a manner which 
clearly shows a general and pomprehensive grasp of the subject. This di- 
I vision might be acJ^ording to function (rooms used r^larly for family 
I living, nonessential convenience rooms such as a laundry room, or an- 
nexes such as a storeroom or veranda) or spatial position. This type in- 
cludes every description which presents a kind of objective map (or 
which adds a map Xo the description, prpvided the- description its^f is 
, "comprehensive" as denned). ' 
- Surveying. A description which presents the rooms and/or their con- 
tents by conducting a "tbur" through the home. In order to classify a com- 
position as, being in this type, there must be,clear signs in'the language of 
the composition: word; which describe, in different places ^i^in the 
composition, the movenent through, the home, or words which attempt^ ^ 
to'c[escribe the precise relative positions of the furniture pieces wjthin 
^ach room and the pasj ing from oije-^oom to the.next. 

"Associative. The orjder is dict^ed by verbal or sound associations 
which can be clearjy demonstrated. There must be various definite in- 
stances of this in fhe co nposition, and its aj^pearance must beconspicu- 

ijement which gives prominence to the writer's 
, the things which make an impfession upon 
_ jssions, matters which affect him or belong to 
to his room, his playtlfingsj. - ^ 
Enumerating the things found in th^e home either by 



ous. 

Egocentric. An arran 
position: his point of view 
him, his ieelings, his impressions 
him (giving prominenci 
j Enumerating. 

\ room (but without clear signs of 



a "survey") or withQMf discernible 



Holistic ^valiuition of Writing 



order* Here also are to be Included those comggsitions in which different 
methods of arrangement are used at once without any one of them domi- 
nating, or which have no signs sufficient to classify them under one of the 
other methods of arrangenient. . . - / 

With this n\odel teachers and researchers could develop feature analy- 
sis scalescfor^y significant aspect of a particular kind of writing: voice 
and style of personal disclosure in autobiographical \vriting; structure or 
pattern in fictional prose; use of details and sensory images in writing up 
observations and interviews; presentation of speaker roles in dialogue and 
dramatic and interior monologue; use of classi|ication and contrast to 
present information in exposition, to mention some possibilities. 

Primary Trait Scoring "^"^TZ: T _ _ . ^ 

Prin^ary Trait Scoring was developed for scoring the essays frjom the 
second (1974) writing assessment of the National Assessment of Educa- 
tional, t^i'ogress. (See the Lloyd-Jones chapter in this collection for a dis- 
cussion of the development df Primary Trait Scorfng and for an example 
of a Primary Trait ^Scoring Guide.) Like feature analysis and analytic 
scales, Primary Trait Scoring yields a score which can be quite reliable 
when raters are given careful training. Primary Trait Scoring guides focus 
the rater s attention on just those features of a piece which are relevant to 

^ihe kinH of discourse it is: to the special blend of audience, speaker role, 
purpose, and subject required by that kind of discourse and by the parti- 
cular writing task. Furthermore, a unique quality of Primary Trait Scoring 
is that the scoring guides are constructed for a particular writing task set in 
a full rhetorical context. This close correspondence of rhetorically explicit 
task and holistic scoring guide is a new development in holistic evaluation 
of writing, a development almost certain to have great jmpact on the eval- 
uatipiv ofwriting. The correspondence peimits a new precision in stating 

-v(?nting research hypothes^' and in devising criterion measures for re- 
search and, curriculum development. As a practical applicafion of new 
rhetorical theories. Primary ^.Jrajt Scoring Will also very likely have an 

^indirect impact on the way^acfcers give writing tasks and ;espond to 
them. Primary Trait Scoring is cerWinly the mo$t sophisticated of the ho,; 
listic evaluation schemes under review in this chapter and potentially the 
most useful. 

GeneraKIippression Marking 

General^ impression marking is the simplest of the procedures in this 
overview of types of holistic evaluation. It requires no detailed discussion 
of features and no suniming of scores given to sepai ate features. The rater 
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simply scores the paper by deciding where thepaper fits wfthin the range 
of papers produced for that assignment or occasion. If the scores are to be 
usea for ranking or for significance testing, raters must use the full range 
of scores availablelfiijrderfo approximaTe a ffdmaTscoreld istribution. As* 

; this procedure hasbeen de\'t loped by Education Testing Service and the 
College -Entrance^amination Board to score the English Composition 
Test (ConlanlS76) anijj^the Advance^ Placement tesjt iir English (R. Smith , 
1975), ratgrTmust train themselves -carefully— become "calibrated'\t6 
reach consensus— by reading and discussing large numbers of papers like 
those they will be scoiimg. (This:procedurQ.>would be a requirement for 

"/obtaining rdhble scor^3y\th any of the holistic stshemes in this overview; 
I will discuss r-;liability problems later.) I should point out, however, that 
James Britton and his colleagues at the University of London Institute of 
^Education (Britton, Martin, and Rosen 1966) have achieved reliabilities as 
high i«^82-bet>^en teams of three raters who were experienced English 
teache/s,buj, \^6 were given only minimal instructions, no training, and 
no chance lo discuss among themselves— either withia teams or between 
teams— the,.stahdards they would use for evaluating. The raters lived in 
djff^ent parts of England, received their instructions and the papers by 
mail, and were paid for their time. 

At ETS raters use a scale of 1 to 4 to score the English Composition Test 
and^a scale of 1 to 8 to score the Advanced Placement test. Holistic scor- 
ing ix\ the first reports of the writing assessment of the National Assess- 
ment of Educational Progress {Writing ^feclianics 1975 ) comes from.la 
reheral iynpressiqn marking ca a scale of 1 to 8. Britton used a scale fronl 
^to 10. . A \ , 

General impression marking may be closer to analytic scale scoring 
than it seems at first. At the scoring of the Advanced Placement test, raters 
follow a "rubric" worked out in advance. The rubric,is concerned mainly 
with the relevance of the answer to the esssiy question atid with the com 
tent of the answ^er, rather thanNvith general features of writing; butit does 
serve to fod&s raters reading of an essay in the way an analytic scale 
does. Even though raters scoring the English Composition Test have no 
rubric or feature list in hand, they have discussed sample papers at length. 
It is, therefore not unre^onable *n assume that th^ are using an implicit 
list of features or qualities to guide their pdgments. 

Center of Gravity Response 

Peter Elbow's "center of gravity" response is iutended not for scoring at 
all but for formative response and feedback. The reader reads the paper 
and then responds to the following: 
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a First tell ver/xiuickly what you found to be the mam points, m&in 
feelings, or cent^ of gravity. Just sort of say what comes to mind for 
. fifteen seconds, for example, "Let s see, very sad; the death seemed to 
be the main event;\mi . . . but the joke she told was very prominent; 
lots of clothes." \ 
b Then sunfimarize it into a single sentence. ^^^^^ 
c .Then choose one woroNfrom the writing which best^summarlfSit. 
, d 'Then choose a word that Wt in the writing which bestsummarizes it. 

Do this informally. Don't plwi oif think too much about it. Th^pOint is 
' ^ " to show the writer what thin]^ he ^r she made stand out most in yqur 

head, what shape the Uiing t^es m your conscfousness. This isn't a- ^ 
test to see whetfier you got thewords right. It's a test to see whether 
" the^wbrds got you rightrBe sure^to use different language from the 
language of the writing. This insur^ that the writer is getting it fU- 
texed through your perception and experience— not just parroted. 

The Elbow scheme, which can be varied an3^adapted in many ways, 
has been used by^teachers at several IcycIs, juiiior high school through 
college. Jt exemplifies the besb ?ort of formative response guide for 
students— a guide which directs them to something m each other's writ- 
ings besides: spelling'^and usi*ge mistakes. An additional benefit is that it ^ 
neatly precludes passing juagiVient onsomeone else's ^tmg. n^./ 

I include the Elbow scheme in ordCTto^broaden my re\aew of holitfc 
evaluation to encompass informal response guides that lead ^e reader to . 
produce a response. From the teachers or students perspec^ve, these . 
will be more useful for teaching than any of the other guides ^. review 
above. A writer planning to revise a piece can certainly learn morci^cjih a 
do?en center of ^avity responses from peers than from a dozen scores on 
an analytic scale; unlesis, of cpyrse, there is time to talk to the raters about 
why they, scored the piece as they did. ^^^fhSe I am interested in exploring 
the possibilities for teachfig all fei^dsj'lcff h^li$tic evaluation guides, my 
main concern in this chapter is to outi^e their uses for conventional mea- 
surement/requirements: prediction of Access in English, placement in 
special bourses, and growth measurelhent. To use the current distinctions, 
I anvmore concerned in this chapter with summative than with formative 
ev^uation. " . 



Analytic Scales 

Following this overview of ^^'eral types of holistic evaluation,' we 
come to a more detailed ejfproration of analytic scales. I want to show 
bow they can be consbjicfeJ and how they might be used in a variety of 
''ways for evaluation^and for teaching. I will also give som^f attention to the 
problems of ac})i^ing reliable ratings with analytic scales. 

^ " /"""^IG 
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I recommend (hat researchers, teachers, and students construct analytic 
scales for use with the major kinds of writing commonly required or en* 
courAged in schpols. One advantage of analytic scales is that they can be 
developed for one kind of writing and then put to use thenceforth with all * 
instances of that'kind of writing, such as autobiographicalyincidents or 
essays about literary works. (See MofFett/l968 for a comprehensive list of 
'kinds of writing. His list is based on notions o( levels of abstraction^ in> 
treating the subject and on rhetorical distance between writer and audi- ^ 
ence.) As useful as analytic scales can be for researchers and teachers 1 ^ 
(certainly they are uii advance over using the Diederich expository scale \ 
with all kinds of writing), they do have some dr^>Kbacks. The main prob- \ 
lem' is that they are not sensitive to the variations in purpose, speaker role, • 
and conception of audience which can occur in pieces written in >he same 
moda Current discourse theory persuades us that a piece of autobio- 
graphical incident, viewed as to its function or purpose, couI$) be either ' 
I expressive, persuasive, referential, or literary, that is, concerned primarily 
I ; with self, other, subject, or language. While we must acknowledge, then, 
• that analytic scales lack certain kinds of precision, we can still demon- 

, • strate their usefulness as general or global guides for responding to a piece 
\ C of %vriting. 

Developing an Analytic Scale . , . 

Procedures to follow in developing an analytic scale are simple though 
time-consuming. Since the features that mak^e up the scale must be de- 
, . rived inductively froni pieces of writing in the\piode for which the scale is 
] being constructed, the first requirement is for large amounts of writing of 
. ^ \two kinds: published professional writing, and original student writing of 
Varying quality. The second requirement is for critical, analytical, or the- . 
\, critical treatises on the particular mode. In the case of personal narrative, 

, , th'S' first scale to be illustrated below, we Collect several dozen 't)ieces of 
autobiography and firsthand ^biography (or merhoir) from secondary 
• . / _ school or college students on whose writing .the scale will eventually be , 
tf^^used. 11len^ve obtain several recently published autobiographies and 
firsthand biographies, including colle'ctions of short pieces. While we're 
reading widely in'the mode of personal narrative, we load a few piecgs^f^ 
criticism and theory, pieces onjhe nature of personal nan<itive^ ^fmode 
\ , of writing. As the re^ding^rogrcsses, we begi^i listing Jmpoff^t features 
\, of personal narratiye. If we are working with othersTon this project-, we 
discuss our lists' of features, shaping and modi^jng them as we try them 
out on pieces of student writing and examine the results. Gradually we 
evojy^a list of featun^s, comprefiensive enough to include the key fea- 
^Jtufes of personaljarrauVe but not so long that a rater-researcher or stu- 
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dent writer would find it unmanageable as a guide to scoring or respond- 
ing. \ ' - 

When the list of features is established, we describe briefly in nontech- 
nical language What we jconsider ^o be high, mid, and low quality levels 
for each feature. These descriptions are helpful in **anchoring" the points 
ak>ng a scoring line. . ^ ^'^'^ — 

These procedures, were the ones followed by four Buffaloarea English 
teachers— Gfeg Anderson, Dale Kaiser, Nathalie Ketterer, and Donald 
McAndrew—and this writer in developing Personal Narrative Writing 
' Scales (PNWS). The PNWS is intended for use eitherbjUughuschaoLstu^ 
dents themselves or. by teachers and researchers who would be rating 
vhigh school students' papers in this mode. The PNWS is designed for use 
with both autobiography and firsthand biography, but scales could also 
be developed for each separately. It can be found in its entirety in Appen- 
dix A. . * 

After practice on several papers using the complete scale as a guide, 
and after inter-rater reliability checks in the instance of a research or cur- 
riculum evaluation study, raters can score papers using either the analytic 
scale or the dichotomous scale. 

There is another scale, a quite different one solely for use with dramatic 
\\Titing, developed in the same manner as the PNWS. This writer and the 
following Buffalo-area teachers developed Dramatic Writing Scales 
(DWSy; Molly-Brannigan, Tom Callaghan, Ann Feldman, Rosemary 
Gates, Warren Hoffman, and Thomas MacLennan. The DWS can be 
found in Appendix B. * * 

Both the PNWS and the DW$ conld have been developed by teacheror 
researcher groups anywhere. They can certainly be modified and im- 
proved. While b6th have been used extensively in classrooms by students 
to guide peer feeJiback, neither has been used in a research study. Conse- 
quently, we do not have rater reliability data to report from the scales. 
However, since both conform in format and general approach to several 
current scales which have been used with high reliability in research stud- 
ies, we are confident the ^ame results can be achieved with PNWS and 
DWS. » 

Uses for Analytic Scales \ 

^the PNWS and DWS and others like them (see Fagan, Cooper, and 
Jensen 1975 for a review of several analytic scales) have a variety of uses, 
some of them already suggested in this chapter. Where a reliable score 
is needed for a student— a score representing his or her writing perfor- 
mance'at one point in time^ relative to the performance of other students* 
writing at the same tiine on the same topic or topics— an analytic scale 
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will guide and focus raters' scoring, insuring enough agreement ito permit 
* a reliable score to come froni summed multiple ratings (see discussion of 
reliability belo\y). This scof e can l>e used for any purpose to which scores 
are ordinarily put ia education: prectiction, placement, exemption, 
growth measurement, program evaluation, or experimental dr correla- 
tional research. The importance of such a score for writing teachers and 
researchers is that it is a valid score, obtained from actual writing and not 
from a multiple^hoicetest of presumed writing skills. ^ * . 

Let's conjecture about what use a high school English H.epaHrtment 
might make of such a scpre. A score for each student based on the same 
set of writing tasks given on sp&:ial School-wide writing days (Diederich^ 
1974; Cooper 1975) permits a rank-ordering of the entire stud«it^ body^ 
and of each grade level. Therefore, we know precisely where a t^tlh 
grader named Susanna stands as a writer in relatton to all the students.in - 
the school (grades 10-12) and to the students in h^ grade level. We have 
^ a great deal of confiiience in Susanna's, relative placement because- the 
task we set was valid (we actually asked h& to write whole piec^ of 
discourse) and the rating or scoring was reliable (we f oUowed proceiiures 
to be outlined below and we computed the reliability of the ritings)hHiir 
score won't tell as anything we need to know to improve ^usann^ywrit- 
^ ing, and so it is quite limited information in the context of the whc^e writ- 
ing program, but it is useful nevertheless. For example, we maj^^eam thit 
Susanna is one of the dozen or so best writers in the tenth-grade'class, ana 
a better writer than three-fourths of the seniors. Where writing is an im- . 
portant part of the English program, ^nd where students are tracked by 
ability, we have an important\piece of information b pass along^^to the 
counselor who plans Susanna's program. Certainly we can make a confi- 
dent decision about placing Sdsanna in a small honors section or in an 
, Advance Placement class. \^ * ^Im^-^^ 

But let's assume students are not tracked £id that each tocher is inter- 
ested in forming heterogeneous small-group writing workshops ea^ly in 
the year. The teacher will know exactly who the six best writers are, Su- 
sanna among them, in the class of thirty. One of the six will go into each of 
the f iO-member workshops. These six best writers could also, at l<»ast 
occasionally, meet together as a woricshop. Of course, the teacher can get 
an approximate ranking of the class \after seeing the first few pieces ot 
writing from the group, but the school-wide ranking may save' time in 
forming v/oikshop groups or planning other olass activities, and it has the 
additional advantage of being objective, of being based on a cooperative 
and unbiased assessment of each student's writing performance. 

Whai ,elsft can we do with Susanna's sQore? We could pair her with the 
lowest-ranked student in the class in a tutoring relationship. We could ask 
her to tutor for pay or for extra credit in the English department's "writing 
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place/* where students from anywhere in th<5 school come for help with 
Aeir reports and papers. We could make it easy for her to volunteer to 
sp^nd an Kour^ or two a week in a nearby elementary school or middle 
— sdhoolrassistinffirteacher in the writing program. Perhaps the journalism 
teacher would want to know about Susmuias ranking, or the English 
teacher sponsoring a Foxfire^type journal, or the history teacher planning 
a large-scale, cooperative, student-writt^ liistoiy of the school or the 
community. . . . 

But what if Susanna had beeQ^aihong the dozen or so lowest-ranked 
tenth-grade writers? There she is, right at tlie bottom of the list— rather 
^'^ difficult to ignore. We know she will need special help. If we get the 
school->yide ranking each year, we wiD kn ow at the end of Grade 11 
whether Susanna remains, at the bottom of the ranking. In that case we 
can arrange special instruj^tion for her dur^g her senior year. 

This reliable ranking of all students by Avriting performance also has 
important public-relations benefits (Coojper 1975). Successive rankings 
permit the English department to^demoi&trate that, as a group, students 
improve as writers during their three yeafsj Susanna's rank will move up 
through the whole student body (grades lO^fSuring hcj three years in 
high school, even though her rank might remain the same within her own 
da!?s.. V . ' /ff • 

^ «, For program evaluation or for researc^^n metkods of teaching writing, 
an analytic scale can serve as a guide to^aters choosing the better of each 
student*s paired pre- and post-essays 0|l matched topics of the same kind 
of discourse (Ollare 1973; OAA\ 1976). Where a criterion measure is re-, 
quired in a research study, raters can lise an analytic scale to score each 
students writings. \i ' J ^ - 

At the collegfe levelthe^e is a need for information about writing perfor- 
mance in order to make^ decisions aliout placement, exemption, or certifi- 
cation. Where college faC^ty will i^t use standardized tests because they 
consider them invalid, analytic sc^es can guide raters' judgments about 
actual writing produced by studenfe. The rank-ordering obtained from a 
test, day can do everything that standardized equivalency tests will do. 
, Appropriate local cut-off pointsqn^Ae ranking can be established in order 
to deteprnine which students may fie exempt from counesor which stu- 
dents ;should be assigned to courses of varying difficulty levels. (In making 
tfies^omments I do jiot want to seem to be supporting examination by 
s el^uivalency testing. My o>vn view is that anyone can profit from a good 
writing course anytime. For me, tlie question is not whether we should 
.> exempt or who we should exempt, but how soon all of us are going to 
start teaching writing as competently as the best writing teachers in this 
country, teachers who regularly describe for us in detail how they go 
about it.) 
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So far I have discussed analytic scales as they are used to guide the 
acquisition of reliable scores for writers, scores which can then be used in 
all the ways we have learned in the last few decades to use normally dis- 
tributed or rank-ordered scores. Now let me discuss some more informal 
uses within the classroom. With the scoring apparatus and the high-mid- 
low distinctions removed, the PNWS and the DWIS can be helpfid guides 
to formative evaluation, to feedback and response to each piece the writ- 
er produces. Such a guide for student use could include the list of features 
in either scale, the short descriptions of each feature, and the description 
of the "high'' level of each feature, perhaps with the statements rephrased 
as questionr for the reader to ask the wpter or to ask of the writer s piece. * 
In this regaxd, the dichotomous scal^foUowiiig both PNWS and DWS 
can be helpful; with the statements rephrased as questions, the scales can 
^-used-like checklistsjduring ihajediring and^evising^ stages. 
ElseWhere in this collection, Mary Beaven explores the possibilities for 
training students to use such guides and checklists for self-evaluation and 
peer evaluation. At least two researchers (Alpren 1973; Sager 1973) report 
tfiat the quality of writing from upper elementary school students im- 
proves when they receive guided teacher or peer feedback from analytic 
scales. . - * 

\ 

The Reliability Problem in Holistic Evaluation ' 

*> 

We all know how unreliable ratings of essays can be; a group of raters 
will assign widely varying grades to the same essay. This phenomenon has 
been demonstrated repeatedly for decades. It is an incontrovertible em- 
pirical fact.. You or I could demonstrate it tomorrow in a simple experi- 
mcait. People who wnte and sell standardized, multiple*choice tests have 
used this fact to argue^that we can get a reliable writing score from stu- 
dents only if we give them standardized tests, or at least give one in con- 
junction with a writing sample and then add the scores from each. 

Curiously, another fact that often is ignored or slighted in discussions of 
the unreliability of essay grades is that we have known for almost as long 
as we have known about unreliability that reliability can be improved to 
an acceptable level when raters from similar backgrounds are carefully 
trained. In 1934 a researcher demonstrated that rater reliability could be 
' improved,f rom a range of .30 to .75 before training to a range of .73 to .98 
after training (Stalnaker 1934). <Aj:eIiability-xoefticient of .80 is consid- 
ered liigh enough for program ^Valuation, a reliability'of":9ftipr individ- 
ual growth measurement in'tearhing or research [Diederich 1974}>)lA 
more recent study (Follman and ^nderson 1967) reports reliabilities for 
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five raters ranging from .81 to .95 oafive different types of holistic evalua* 
tion. Another recent study (Moslemi 1975) reports a reliability of .95Jor 
" three raters scoring **creatiye" writing. In a- school-district curriculum 
evaluation study j\^t completed here jat Buffalo, Lee Odell obtained 
* agrewpents between^ two raters of 80?, 10055, and 106t in choosing the 
ibpltCT essay in each of thtty pairs of pre/posttest essays, in each of three 
kinds of writing. The ratars, both experienced teachers and graduate stu- 
dents in English education, spent an average of an hour of training time 
preparing to judge each kind of writing. , : 

As emphatically as I can, then, let me correct the record about the relia-. 
bility of holistic judgments: When raters are from simitar backgrounds 
and when they are Gained with a holistic scoring guide-^either one they 
borrow or devise for themselves on the spot — they can achieve nearly 
perfect agreement in choosing the better of a pair of essays; and they can 
achieve scoring reliabilities in the high eighties and low nirieties on their 
summed scores from multiple pieces of a student's writing. Let me bring 
up some support. In a study of the reliability of grading essays, Folknan 
and Anderson (1967) conclude: 

It may now be suggested that the unreliability usually obtained 
irt the evaluation of essays occurs primarily because raters are to a 
— — eonside^able degree heterogeneous in academic background and 
have had different^experiential backgrounds which are likely to 
produce different attitudes and values which operate significantly 
in their evaluations of essays. The function of a theme evaluation 
procedure, then, becomes tha]t*of a sensitizer or organizer of the 
rater's perception and gives direction to his attitudes and values; in 
other words, it points out what he should look for and guides his 
judgment. * . / 

Farther assurance comes from Coffmari (1971)'; "In general, when made 
aware of discrepancies, teachers tend to move their own "ratings in the 
direction of the avefage ratings of the group. Over a period of time, the 
ratings of the staff as a group tend to become more -reliable." 

And now we come to the main constraints on achieving reliable scores 
of writing performance: cooperation and time. Reliabilities as high as the 
ones I mention above are never possible from one rating of one paper. 
Why? Writers vary in their performance, and raters disagree, even when 
they are alike and have been trained carefully. To overcome these diffi- 
culties we must have at least two pieces of a student's >\Triting, preferably 
written on different days; and we must have at least two independent 
ratings of each piece. Further, we must permit the student to give us his or 
her best rehearsed or researched performance under controlled condi- 
tions to insure that the student actually does the writing hi'm or herself 
even though he or she may be using notes (see Sanders and Littlefield 1975 



29 



20 Charles R. Cooper 

for procedures for obtaining rehearsed writing). Finally, there are theo- 
retical reasons trf feelieve that the writing task we set for the students ' 
should specify a speaker ifole, audience, and purpose (ifle the Lbyd-Jones-^ 
chapter). - i"^ ' ' . 

The raters themselves must be carefully train^. They shoiild practice 
using the holistic scoring guid^ with sample papers exactly like those they 
will be scoring, and they must'be kbleto make their judgments within the 
context of the range of performances in the particular set ^f papers they 
are scormg. Scoring is always r^plative to the set of papers at hand and 
must fake account of the writing task, the conditions luider which the 
writing was done, the age and ability of the students, and the full range of 
quality of the papers. Reliability cannot be achieved when some raters are 
using an absolute standard o^ quality, perhaps that of published adult 
writing. Some papers must reteive the highest scores, some the lowest, 
and most the scwes in the middlexange. Raters should check the reliabili- 
ty of their ratjngs during training to insure they reach an acceptable level 
before they begin the actual scoring. Then once the scoring is underway, 
they should .periodically check themselves on perhaps every twenty-fifth 
paper (Diederich 1974 offers simple procedures for determining reliabili- 
ties). : • , * 

Over the last few years several researchers have thoroughly explored 
the causes of variation in writing performance and rater judgments, and 
summaries of this research are available (Braddock, Lloyd-Jones, and 
Schoer 1963; McColly 1970; Britton, Martin, and Rosen 1966). At the same 
time, severid writers have worked out in some detail ways we can ade- 
quately overcome these problems (Diederich 1974; Cooper 1975; Sanders 
and Littlefield 1975). Consequently, where there is commitment to valid 
measurement of writing performance, it can be achieved. 



Conclusion J 

In this chapter I have reviewed various types of holistic evaTuatioh of 
writing and have discussed at some length one kind of holistic evaluation, 
the analytic scale. Already widely used by teachers and researchers, it can 
be put to much more sophisticated and comprehensive uses than it has 
been; and I have proposed a number of refinements and uses at^yarious 
levels of measurement and evaluation. Whether we need scores for pre 
diction, placement, exemption, or growth measurement, or whether we 
need a guide to informal diagnosis or feedback, analytic scaks^can be 
useful. Most important, when we need scores, we can be confident we are 
obtaining them in a valid way, from human responses to actual pieces of 
writing. 
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^There is, of caiirse^.a serious /eliaMit)4i>roblem. To overcome it, 
roups of teachers or researchers have to work together to train them- 
selves as raten. They have to cooperate further to obtain multiple inde- 
►CT3elit:rAtihgs^if^t least two pieces of a student's \vriting. Andjhey 
^Aave to be willing to spendjhe time required to do this worfe two ratings 
if each paper written by l506Tii|^.§chool student require IdO hours of 
rkting time. As large as alime requirement^lOO hours seems, it serves 
|ainly to remind us how much time secondary school and college English 
achers regularly spend reading student papers. The holistic rating 
piSocedlires I am recommending require 'no more than two minutes per 
paper, an amount of time far less thar. teachers ordinarily spend respond- 
ing to a paper during the writing course. What \ye gain from the time we 
spend rating papers is a valid normative measure of a student s writing 
pOTormance. ^ . 

• Kven if we are not concerned with obtaining reliable scores, we can still 
putlanalytic scales to tise in the classroom. They provide a public state- 
ment of the general features of writing stressed in a writing course, and 
they provide a focus ]|or students' examination of their own writing and 
thejwriting of others. They insure that any response to writing will be 
apnropriatfe to its type, reasonably comprehensive, and^ concerned, at 
least in part, with substantive matters. 
■ /' , 

' , Appendix A: Personal Narrative Writing Scales 

L ^ General Qualities: x l 

A.' Authors Role \ 

. The author's role is the relationship of the author to the subject, inci- 
dent, or person. In autobiograpK^ the author writes about himself/ 
herself. He/she is thq main participant.'Most of the time he/she will use 
the pronouns; I, me, we, us. In biography the autho^writes about some 
^ V other person. He/she is not involved in vi^hat happens; he/she^is just an 
observer. He/she uses the pronouns, he, she, him, her, it, they^ them. 

High 'The author keeps his/her correct role of either participant or 
' ^ ! observer throughout. / 

MiddleA In autobiography, a few noticeable distracting tipafes the au- 
/ \ thor talks too nuich about another person's actions; or, in bi- 
' / ography, he/she talks too much about his/her own actions. 

Low The author talks about himself/herself or others as participant 

/ or observer anytime he/she pleases so that you can barely tell 

I whether it is supposed to be autobiography or biography. 

I There is confusion as to author s role. He/she is not consistent- 

' ly either observer or participant. 
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B. Style or Voice 

- High' The author states what he/she really thinks and ,feeis. Ex- 
pressing personal experiences, the writer comes through as an 
individual, and his/her work seems.like his/hers and his/hens 
alone. The voice we hear in the piece really interests us. 

Middle ^The author uses generalizations or abstract language, seldom 
including personal details and comments. While the piece 
may be correct, it lacks the personal touch. The voice.seems. 
bland, careful, a little flat, and not very interesting^ 

s Low . We don't really hear a recognizable voice ir^tlie^ piece. The 
styte seems flat and lifeless. 




C' . Central Figure 

Details about the central figure make him/her keem "real." The char- 
acter is described physically and as a person. / 

^^High Th^ central figure is described in s\{ch detail that he/she is 
al\N'ays "real" for you. / \ . 

Middle The central character can be "seen," but is not as real as 
he/she could be. * • / \ 

low The central character is not a real living person; he/she is just 
a name on a page. You cannot 'see him/her or understand 
him/her. 

D. Background ^ * 

The setting of the action is detailed so that it seems to give the events ' 
a "real" place in which to happen. 

High The action occurs in a well-detailed place that you can almost 
see* 

Middle Sometimes the setting seems vivid and real; but sometimes 
the action is just happening^ and you are not really aware of 
what the setting is. ^ 

Low The action occurs without any detailed setting. You see the 
action, but you cannot see it in a certain place. 

E. Sequence 

The order of events is clear, giving the reader a precise view of the 
sequence of incidents. 

High The order of events is always clear to ybm even if at times the^ 
author might talk about the past or the ivUture. ' ^ 

Middle A few limes it is not clear which event hapi>cne3 first. 

U)W You really cannot figure out which event comes fir5t or goes 
after any other event. ^ ^ 

F. Theme ^^-^ * : 

The aulhor^^lu>osres the incidents and details for some reason. There 
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seems to be some purpose behind the choice of subject matter, some 
theme holding it all together and relating the parts to the whole. There' 
stems to be 'a poinl\to it. 1 

High \ The impbrtaoce of the author's subject is either directly ex- 
\ plained to you or it is implied in a way that makes it cl^ar. 

.Middle You can see wby the author's subject is important tp him/her, 
V but it is not as clearly stated or implied as it could be. 

\» ^ ^ ' 

Low You cannot figure out why the subject is important to the au- 
thor. . I • v' ' * 



II. Diction, Syntax, and Mechanics 
« 'A. Wording 



High 

N 

\Middle 

Low 

. Syntax 
. High 



Words are employed in a unique and interesting way. While 
some of the language might be inappropriate, the author 
seems thoughtful and imaginative. 

r 

Common, ordinary words are used in the same old way. The 
paper has some trite, over-wqrked expressions. The author, 
on the other hand, may work so hard^at being different that 
he/she sounds like a taU<ing dictionary, in which case he/she, ^ 
also, merits this rating. 

The word choice is limited and immature. Sometimes words 
are even used incorrectly— the wrong word is used^ 



The sentences are varied in length and structure. The author 
shows a confident control of sentence structure. The paper, 
reads, smoothly from sentence to sentence. There are no run- 
together sentences or sentence fragments. 



Middle The author shows some control of sentence structure and only 
occasionally writes a sentence which is awkward or puzzling. 
' Almost no run-ons and fragments. / 



Low 

Usage 
High 



Many problems with sentence structure. Sentences' are short 
and simple in structure, somewhat childlike and repetitious in 
their patterns. There may be run-ons and fragments. 



There are no obvious errors in usage. The author shows 
he/she is familiar with the standards of edited written Eng- 
lish. 



Middk A few errors in usage appear in the paper, showing the author 
has not quite been consistent; in using standard forms. 

[jOW The writing is full of usage errors. 
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Q. Punctuation 

-\H<gA The author consistently uses appropriate punctuation. 
iddle Moji of the time the writer punctuates correctly. 
The writing contains many punctuation errors. 
E. Spelling V . ^ I ' 
HigfcA All words are spelled correcUy. 
Middle \A few words are misspelled, i 
JJow N^any words are misspelled. 



Analytic Scale 

'Reader 



General Qualities: 

A. Author's Role 

B. Style or Voice 
Central 5'igure 

D. Background 

E. Sequence 

F. Theme^ 



Low 

2 
2 
2 

•2 ' 
Z 
2 



Paper. 



Middle 



II. Diction, Syntax, and Mechanics: 



A. Wording 

B. Syntax 

C. Usage 

O. Punctuation 

E. Spelling 



High 



4 


6 


8 


10 


4 


6 


8 


"10, 


4 


6 


* *8 


10/ 


4 


6 


8 


10 ^ 


4 ' 


6 


8 


10 


4 


6 


8 


. 1(< 

/ , 




3 


" 4 


5 




3 


4 


5 


.2 


3 


4 


5 


2. 


3 


4 


5 


2 


3 


4 


^5 



Total 



II. 



YES . 



Dichotomo)^s $^calc 

Reader / | 

NO 



Paper. 



i Author's role consistent 
Interesting personal voice 
Theme clearly presented 
Background rich and supportive 
Sequence of events clear 
Central figure fully developed 

W(brding unique and developed 
Syntax correct and varied 
^ Usage errors few 
Punctuation errors'few 
Spelling errors few 



.Total 



Yes- 
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^The language of dramatic writing is different from other types of writ- 
- jng be cause it is meant to^bfe heard. \Ve expect the langua^ejctbe in the 
. '^resentHa[jse, l^ecause the events unfold as we watch aficTTisten. Another 
] special aspeci of the language of dramatic writing is that there is no narra- 
\tor or voice to tell us of descriptioris and histories. In dramatic language 
misinformation is hidden in the face-to-face, ongoing conversations of 
the characters. While each character speaks, other tenses than the present 
>' are used to talk to other characters. For example, one character re- 
late to another a past series of events leading to the present situation. The 
^'^'^ stage directiogs^ve hints to the actors concerning their actions and tone 
of voice, which the narrator would otherwise tell about in a descriptive 
/ section of prose. ' , ' - - 

; I. Language Factors 

\.. Conversation: Realism 

Does the conversation ^somjd realistic? 

Hi^h The characters* conversations go on as if you were eavesdrop- 
j ' ping (secretly listening) to their talk. Everything that is said is 

I very clear to you. 

' « Middle The characteirs* convarsation sometimes leaves out something 
j important. Almost everything that is said, u clear to you. 

I Low The . characters* conversation leaves out so much that you 
/ have trouble understanding what is said. 

I B. Conversation: Situation 

Does the way the characters talk match the situation they are in? 

; High , The characters talk exactly as you wotild expect in the situa- 
\./ • tion. 

Middle The characters talk as you expect in the situation most of the 
^ time. ' , 

Low The characters do not talk as you would expect in the situa- 
tion. 

. Stage Directions 

If stage directions are used, are they short and clear? 

High The stage directions tell the actors how to act and speak when 
you cannot decide from the characters' talk. 

Middle The stage directions tell the actors how to act and speak most 
of the time. Sometimes they leave information^ out or repeat 
^ information. ' / j 

Low The stage directions confuse the actors about howjp act and 
speak. 



ShapeJjtctors 
A. 
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beginning , 

Qoenreading the opening linesjof 1his dramatic writing make you 
Twant to continue? Do thevjnake you feel that what follows will be 



' interesting? 

High I ani intrigued by the beginning. It seems interesting and 



makes me want to continue the reading. 



Middle tft^ beginning is taferesting; however, I have seen this Begin- 
ning used before. Its not all that unusual. \ 

Low- The beginning is not particularly interesting. It gets the|dra- 
matic writing off to a slow start. 

B. Stiucture 

Structure refers to the way this dramatic writing is built, or put to- 
gether, with a begirming, middle, and end. It has to do with the wa>| the 
parts fit together, the overall design which reveals the problem '^nd 
how that problem is solved. \ - 

^ High The elements of the dramatic writing are tied together in an 
interesting, well*organized manner. There is a good deal of 
detail and a resolution th^t is believable. 

Middle AltHoiigh there is some attempt at proceeding from beginning 
to end in an organized manner, you are unsatisfied.^ This could 
be due either to a "forced** conclusion to the writing or to the 
writer s faUure to tie all the elements together very successful- 
ly. 

Low The sequ. ce of events .is confused, rambling, fibt well- 
organized. Very little detail is given. ^ ^ . : 

C. Ending " ' " ^ 

The ending is the dramatic writing s conclusion. It is reached af ter a 
problem has been resolved. ^ 

High The ending follows sensibly from the stoiy. Is unique, very 
' well stated, and, possibly, is a suri)rise ending. 

Middle The ending. makes seiise to the dramatic writing but is not 
- — ^very unique or unusual. ' ^ 

Lou; Very ordinary and usual. The ending is just what you expect- 
ed and does not surprise yon. It may not resolve the problem 
posed in the writings or it may not resolve it in a believable 
manner. 

Cliaracterization Factors 

Having characters that are well-devbloped and real to the readers is 
an important part of dramatic writing. Making the reader understand 
how and why t'.ie characters act the way they do will give the reader a 
more personal and interesting view of the entire dramatic piece. 
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A. * Development and Cr^ciibility 

All the characters in the writing should be as much like real people as 
possible. The reader should be able to see the difference between the ^ 
major and minor characters. Major cliaracters (the important ones) 
should be more fully developed. The reader should know a lot about 
them. They should see him/her acting and reacting in many different 
situations. Minor characters (less important ones) also have to he realis- 
ticj but the reader doeSn t have to know as much about them- 

High All major characters seem to be like real people. Each charac- 
ter is a different person, and the reader has no problem telling 
which character is which. Minor characters are also real, but 
• they aren't as detailed as major ones. The writer tells the read- 

er much about his characters through dialogue. Narration is 
kept to a mininium. 

Middle Not all the characters seem Jike real people, all the time. 
Sometimes they do things that real people probably wouldn't 

, ^orThe reader hjp a hard time telling which characters are 

. which. They all seem alike. 

Low \ittle about the characters seems real. They act in ways which 
; mo^t pc?Dple wotildn*t.*Tbere is no difference betweenmajor 
•^nd minor characters.. The characters arie almost entirely de- 
scribed by narration, with little use of dialogue. 

• B. Consistency, ' ' ' 

The characters seem like the same people throughout the piece of 
writing. Their emotions might change (they may change by laughing, 
r - . cryingrfeeling happy or sad, etc.), but their basic personalities will re- 
main the same. (Jji boy who was very stingy with his money at the be- 
. ginning of the story wouldn ^-suddenly star*-giving-money-away4or no 
reason.) 

High All the characters remain the same throughout the piece. 
Their personalities do not change. If there is' a basic change, a 
reason is given for it in the dialogue. 

Middle The characters do not always seem like the same people. 
There are times when they do things that don't seem to fit. 

^Low The characters' personalities are constantly changing, ^e 
reader never, knows what to expect from them. 

IV. Mechanics Factors ^ 

A. Dramatic Forin^ 

Dramatic Form refers to the physical arrangement of, words ore the 
paper. Is the physical form of the paper such.that the reader wants to 
^C""^^ continue reading? The names of the cliaracters should come before 
their lines, and be set off to the .left, followed by a colon. If stage direc- 
tions/are used, they should be enclosed i-^ parentheses. 

High The form is nearly perfect; stage directions are set off by par- 
entheses. 
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Middle ITiere are a few errors in f omi or occasionally confusing stage 
directions. 

Low The paper contains many errors in dramatic form; characters* 
nani^ are omitted or put in the \vrong places. Stage direc- 
tions itre run into the characters* lines. 

^ ^. Spelling ^ 

Dialect spellings are permitted in dramatic writing. Where they are 
used, they should be consistent so that the actor vvpuld have no diffi- 
culty reading the character*s lines. 

H igh AU words are spelled correctly, even the most difficult words* 
Dialect spellings are consistent, 

^ Middle Only a few words are misspelled. Dialect spellings are mostly 
consistent. 

Low There are many misspellings, even of very ordinary words. " 
. Dialect spellings are inconsistent. 

C. End Punctuation 

High End punctuation occurs at natural places, thus making the 
dialogue easy to follow. 

Middle There are onl:^^ a few errors in end punctuation, without mak- 
ing the dialogue difficult to follow. \ 

Low End punqluatiojrfnarks are either not present or are placed so 
that often the dialogue is hard to^follow. 

V. Response Factors 

^ Rather than focusing your attention on one aspect of drama, in this 
section of the scale yo\i will be asked to assess the dramatic work as a 
whole. The questions under thisiieading ^^he scale wiH\)robably be 
the easiest for you to answer because ypuicnow what you like and dis- \ 
like. However,'you should try t({use your answers to these questions as 
• guides in answering the oth^ more specific questidns. For example, if 
you really enjoyed a work^ fry to decide what aspect of the work made 
it so successful. 

A. Entertainment • 
High • I felt the work was very entertaining. 

Middle I was only mildly entertained by the work as a whole. 
Low The work was not entertaining. 

B. Originality ^ ^ 

High The work made mt think about something in a way that I 
vhadn't previously, coasiderod. ^ 

Middle While there were^some moments of orig inality in th c^work/ 
there were a' lot of ideas I had heard before. ^ ^ 



ERLC 



Thw There was nothing new in this work. 

■ '. ■ -d-d 
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Reader Score Sheet, 



-DIRECTlONSr .For each quality, listed below, circle the number U»t niost 
nearly describes the position of thb paper on the following 
I scale irom high to low. 

LANGUAGE jPACTORS HIGH ' ; MIDDLE LOW 

1.1 CoUYcrsatioi - Kealism 5 4 2 1 * 

1.2 Gonversatioil - Situation 5 4 3. 2 1 

TT^Seiie Directions. ^ 3 2.1 

/ • TOTAL LANGUAGE SCORE: £ 

/ 

SHAPE FACTORS* 

ILl/ Beginning. .\ r.. .... 5, 4 3 2 1 

Ili Stracture 5 4 3 2 1 

IlS Ending ;5 4 3 2 1 

TOT'aL shape SCORE: . 

CHARACTERIZATION FACTORS l\ \ ^ ^ 

. III.1 Development 5 4 ^ 3 2 I r 

in.2^ Consistency ^ 4 i.3 2 1 , 

TOTAL CHARACTERIZATION SCORE:' -Ji-J 

MECHANICS FACTORS \ 

IV.l Dramatic Form 5 4 3 2 1 

IV. 2 SpeUing.: 5 4 3 2 1 

' IV.3 Punctuation 5 4 ^ * 

TOTAL MECHANICS SCORE:' 

* RESPONSE FACTORS 

V. l Entertainment 5 l 4 3 2 1 

V.2 Originality... ^. 5/ 4^ 3 12 1 

TOTAL RESPONSE SCORE: 

"TOTAL SCORE: 
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Didiotomous Scale 

YES NQ " ^ ' 

* - , ' ^ 

LANGUAGE' * - • 1. ConversaUon sounds retlistic 

— 2. Characters' talk fite the situ*- 

' Uon. 

<3. Thece are sUge directions. 

4. Stage directions are daur. 

SHAPE 5. Opening lines are interesting., 

— 6, There is a'definite beipnning: ' 

» ^ 7. There is a definite ending. 

1. 8. The ending is interesting. 

CHARACTERIZATION 1 9. The c6aractere seem real. 

10. The charac^rs are consistent. 

MECHANICS - ^ 12. The form is^oonsistent 

— : — 12. OpelUng rules are observed. 

13. Punctuation rules are ob- 
served. 

RESPONSE 14, The^workisentertaimng. 

15. The work made me thUik 

bout something in a way I 
hadn't previoudy considered. 

i 

Totals: 
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^' .Although originally dweloped as a me^ of surveying the writing abi^fy 
o of large numbers of students, Primary Trait Scoring procedures cani>e 
, used for several purposes. They can be used to make summative evalua- 
/ tions of students* writing and to generate numerical data for research 
studies and curriculum evaluation projects, but they also provide a de- 
tailed, precise description of students* performances on a specific rhet^i-* 
cal task. Teachers can use this description as a diagnosis of studaits* writ- 
ing abilities and as a means of providing students with formative 
evaluation. Primary Trait Scoring is not concerned with qualities of 
A^Titing— syntactic fluency, for example^-that are presumed to be charac- 
teristic of all good writing. Rather, it asks readers to determiiie whether a 
piece of writing has certain characteristics or primary traits' thaLju-e cru- 
cial to success with a given rhetorical task. Based on a Carefully worked- 
out theory of discourse which can provide a valid and reliable picture of 
students* writing. Primary Trait Scoring is one of the most promising al- 
ternatives to standardized, multiple-choice tests of writing. 
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In discussing tests of writing ability, one should have in mind a work&g 
definition of "writing," since that term is used equivocally to refer to any 
part lbf the large range between "handwriting" and "great literary works." 
Here, "writing" is syndnymous with "discourse." And discourse will be 
discussed in terms of its aims, which relate to the functions of language, 
and in, terms of its featureSy which are the separate elements, devices, and 
mechanisms of language. Judgipents about the quality of writing are— or 
should be— primarily related to aims (i.e., does the piece ot writing fulfill 
its purpose?). Yet to be informative about those judgments one must be 
able to describe theVriting in terms of its features (e.g., the level of vo- 
cabulaiy). 

Tdsts of writing ability are either atomistic or holistic. Atomistic tesjts 
rely on the assessment of particular features associated with skill in dis- 
coursing, whereas holistic tests consider samples* of discourse only as 
whole entities. Holistic tests are of two kinds: those that deal with a piece 
of writing as representative of all discourse (such as the method|j^er£ected 
: by the Educational Testing Service) or those that isolate subcategories of 
the i|niverse of discourse and rate writing.samples in terms of their apt- 
ness within the prescribed.range (such as the Primary Trait S^coring meth- 
od ,as developed by the National Assessment of Educational Progress). 
Atomistic tests are easier to use, cheaper, and probably more reliable;'but 
holistic tests are potentially more valid, and in particular. Primary Trait 
Scoring is potentially ijiore informative. 
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" ' Atomistic Methods 



Th^ range<of atomistic tests in common^use illustrates their value. Say- 
: • ing Tl^gotta use words when I taOc to you" suggests that vocabulary is a 
, measure of sldll in wn^ting. Vocabulary tests are used for so many kinds of 
estimates of human ability that w e might not even think of them as tests of 
, skill in ^iiscourse. To be sure, we use the results of vocabulary tests for 
placem^t m freshman English and for admission to college or even grad- 
uate school, thus demonstrating that we correlate vocabulary develop- 
ment wxA general skill in discourse. But one look at any academic 
joumaT— or worse, the manuscripts as they are submitted— is enough to 
dispel tbe\idea that the size of the vocabuliuy is a valid measure. Although 
one must have a large^vocabulary in ord^to4iscourse well on a variety 
of topics^' it does not fdllow that a large vocabulai^^ itself is eiiough to 
ensui^e skiU^in discourse. The vocabulary test is, at best, a device for find- 
ing out Whether a person might control merely one feature necessary for 
skill in writing. 

Variations. W vocabul^ tests have been designed. NAEP has used one 
that counts the average'number^of letters per word used by essay writers, 
' but the results can't be associated with the quality of the writing, proba- 
• - ^ly because wprd length in itself has little to.do with aptness of choice, 
and averages conceal the more important issue of range. Sophisticated ^ 
literary critics haVe examined short texts in terms of the etymology of 
words chosen, the percentage of polysyllables, or the rankin|;s of words 
on word frequency lists for .writing. The counting, even when intellectual- 
ly complicated, can be s&tisfyingly exact, but until such counts are related 
to skills in discourse, we will not have learned much about how to evalu- 
ate writing Samples: • ' ' ' ^ 

A common test used for college entrance and many English achieve- 
ment or "exit" examinations is a test of conventional usage and manu- 
script mechanics^ Recent discussion about its misuse has centered on its 
billing as a test of writing skill. It is, of course, a test of social cdnfbrmlty, 
>^f.Jj5?^,y^^^J ^ person recognizes the language forms most commonly used 
by those in authority in America. The test undoubtedly sorts^out the peo^ 
; pie who' will succeed in college, but that does not make it a test of skills in 
discourse. 

r:^^ We are more familiar with tfie use of larger syntactical or rhetorical 
• units for measuring maturity or clarity in discourse. On one hand, we 
measure sentence length and complexity, we search out *T-units" or kinds 
of embedding to indidate the growth of sophistication iaexpressing ideas. 
The units can be described quite rigorously—perhaps almostas precisely 
as one can define words— so the tests can be reliable over a period of time 
even though the complexity of description may require expert reader^ 



dealing with small samples. In a parallel but less rigorous way, readability 
formulae are used- to describe technical and business prose in order to 
identify what might be hard to read. Sometimes features of vocabulary 
are counted in the formulae, but most of the issues are related to syntax 
and sentence length. Since. these larger units depend upon organization 
and subordination— that is, emphasis— they are more plausible symptoms 
of skill in discourse. The quality of the sentence may seem to be inde- 
pendent of the kind^of discourse (a moot proposition, in fact, but conclu- 
sions about the maturity of writers based on studies of syntax seem to 
make the a$^umption, as do conventlpnal literary descriptions of style) so 
gathering sainples of writing is relatively easy and the information ob- 
tained is fairly spnecific (number of words, number of dependent clauses, 
kinds of embedding, etc.). Just a modest extension of the act of checking 
subordination within a sentence leads to examining conjunctions and oth- 
. er words which suggest emph^is within a paragraph, and thus leads to 
assumptions about coherence in discourse. Unfortunately we lack norma- 
* tive datai and our existing observations— the "lore" of coherence— may 
. not be appropriate in a new age of nonverbal electronic communication. 
. Although most moderately educated people have learned to accept 
changes in the lexicon of English and most scholars have learned to accept 
changes of usage and syntax, we are not well informed about fashions or 
basic changes of rhetorical conventions. Perhaps such changes occur in 
gross ways and are therefore'conscious enough to be view«j merely as 
stylistic strategies. Still, an analogy to developments in filmmaking migKt 
be suitably cautionary. A young person brought up on current techniques 
of cinematic transition— abrupt shifts of .space, time, and point of view — 
thinks the elaborate explicitness of films in the 1930s is slow, or even .""ver- 
bal.'* Even those of us brought up on films of the thirties suffer from nostal- 
gia when we view the old elaborateness. Similarly, Lecause of our d^p 
conunitment to written languagej^especially to classic texts, we may haye 
a much more difficult time responding to changes in rhetorical customs m 
prose. Research in such problems will always rollow the fact of change, 
and the problem affects all of our examinations of discourse. 

Some more complex atomisticP-observations appear to deal with ele- 
ments of rhetoric and thus seem less atomistic. Rating scales seem to ap- 
ply to the whole discourse. Papers which are scored in terms of organiza- 
tion, ^evidence, diction, or combinations of these or other rhetorical fea- 
tures-may be nominally judged in toto; the named "features" are elements 
of discoursfcr, but tKese features, in fact,, are isolated from the context by a 
reader and scored separately— an atomistic system tied to abstract cate- 
^gories associated with traditional rhetorics. Often the definitions of cate- 
5^ gories age quite vague, and at best they may be arbitrary. After all, exactly 
'what is 'diction? The scpring^weight of a parti<«ular category is 
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usually expressed in a fixed point system which is not adjusted for differ- 
ent Id^ds of discourse; there is no effort to adjust the points to tell, for 
example, whether evidence is as important in self-expression as in persua- 
sion. And since organizational patterns may difl[er widely for different 
kinds o^ discourse— or for different subjects treated similarly — the preci- 

\sion of Categories is more apparent than real. Various kinds of scoring 

^ guides^ once popular and still represented in marking guides of freshman 
handbooKS and on various fliagnostic tests, ^e not reifable or even espe- ^ 
.daily valid as ways of recording information about large samples of writ- 
ing. They\serve best as convenient shorthand for explaining judgments 
about writ^ng to students. \ ' 

. Atomistic tests, then, may deal with the smallest units pf discourse (vo- 

> cabulary, us^e, syntax), the kind which can be easily adapted to machine 
grading,' or with relatively pervasive elements of discourse (concreteness, 
coherence, liveliness), which must be described by trained human read- 
crs* A user of^the tests presumes that the correlation betweten mastery of 

' the feature and the ^ 5>f discourse is close enough to permit practical 
judgments about ;SkiU in writing. NAEP gives the results of several of 
Jhese kinds of ^examinations in its reports in Writing Mechanics. Even- 
though they may not jbe valid and persuasive tests of discourse, they pro- 
vide knowledge ^bout particular features of language which are import- 
ant to many of us. We often teach in terms of the specifics, and certainly 
/)ur ability to talk about writing depends on the existence of reliably de- 
fined features and categ9ries. We need more data about how features of 
writing relate to writing performance in the real world before we can be 
confident! of our assumptions in the test world. ( 



\ Holistic Methods 

Holistic tests are ba^ed on the idea that a valid tes{ of discourse depends 
^ upon the examination of a sample of discourse as a whole, not merely as a 
collection of parts. One need not assume that the whole is more than the 
suni of the parts— altho\j^ Ldo— for it may be simply that the categoriz- 
_able parts are^o numerous and too complexly rebted tapermit a valid 
repoitrSome recent efforts to combine human judgment with a. compu- 
ter s memoiy, at leasf^tihe_pragmaticjevel,^e-based on this less-de- 
manding assumption. . 

If one decide^ that a valid (or publicly acceptable arid persuasive) test 
requires both a sample pf discourse and a human reaction, then one must 
elect someTiolistic system, precisely defining th^ segment of discourse to 
be evaluated. Tfie writing sample m ust reflect the w riter s choi ces ra ther 
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-than the testniaker s choices; the criticd response must be aflFective as wel 
as cognitive, and must interpret unconventional and creative language as 
well as report conventional devices. For purposes such as classroom 
placement or equivalency credit/ where there are other procedures.jto , 

V assess individual exceptions, the ETS method and its variants are proba- 
bly adequate and relatively siniple. Sef5 Paul Diederich s most readable 
obmments in Measuring Growth in English for a general review, and see , 

*^ his Dibliography for leads to more technical accounts. 

The^methods perfected by ETS.assume that excellence in one sample 
of one mode of writing predicts excellence in other modes— that is, good 

* writing i^^ood writing. Some allowance is made for "having a bad day" 
or. other problems of the test situation. In contrast, the ]^rimary<Jrait Sys- 
tem developed under the auspices of NAEP* assumes that the writer of a 
good technical i;eport may not be able to produce an excellent persuasive 
letter to a city council. A precise description on census of writing skills is 
far richer in information if the observations are categorized according to 

. thcipurpose of the prose. The goal of Primary Trait Scoring is to. define 
precisely what segmen^of discourse will be evaluated (e.g., presenting 
•rational persuasion betv^een social equals in a formal situation), and to 
train readers to render holistic judgments accordingly. 

The chief steps in using the^Primary Trait Scoring System are to define 
the universe of discourse, to deyise exercises wl;iich sample that universe 
precisely, to ensure cooperation of the writers, to devise workable scoring 

\ guides, and to use the guides. ""-^ ^ * / 

Choosing a Discourse Model 

In order to report precisely how people manage different types of dis- 
course, one must have a model of discourse which permits the identifica- 
tion of limited types of discourse and the creation of exercises which sti- 
mulate writing in the appropriate range put not beyond it. The three-part 
model Klaus and I selected was based on the purpose (goal, aim) of the 
discourse and reflected whether the character of the writing grew^out of a 
focus on the writer, the audience, or the subject matter. (Perhaps yve show . 
the influence of Aristotle and his interpreters, and we will take any credit 

^NAEP supported a scoring conference which included five people from NiCTE:^ Robert ^ 
Gorrell, WUIiwd Irmscher, Richard LIoyd-j6nes, Louis Milic, and Donald Seyboid as well as^ 
Ellis Page, WUliam Coffman and several Staff test specialists. Later NAEP asked Carl H. 
Klaus and Lloyd^Jones to elaborate the system both in theory and with practical scoring 
guides. In developing the guides they w^ere joined by Seyboid and six others. The guides 
were then checked for feasibility by Westin^buse Learning Corporation under the direc- 

• tion of Louise,b1ana, who contributed substantially to the refining of {he ideas. 
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we. can earn by that allusion.) Contrasting available two- or four-part 
models may suggest the issues at stake and thus define our choice. We did 
not seriously consider more elaborate models, for example, Jakobson s 
six-part model. . 
» If we had chosen a two-part model— say, Britton's notions of "specta- 
tor * and "participant" writing— we would have echoed the two main ob- 
jectives of the second round of N AEP s writingassessment: self-expression, 
and social effectiveness. It is an excellent mbdel for directing observations 
of the gradual socialization of children, but it tends to take for granted the 
demands of the subject,. of information processing which is important to 
responsible adults and Uius to the schools. The two-part division may be 
said to include some information processing as a part of a Kantian dis- 
covery of a priori f omis within the self (temporal and spatial issues, for 
example), and on the other hand, to include some other information pro- 
cessing in the learning of standard public, procedures for getting along in a 
society (report writing or business letter writing). Still, by limiting the 
observations about the writing to the participants in conwnunication, the 
encoder and the decoder, the two-part division diminishes our sense of 
how the external reality influences our reasons for >yriting and how the 
code itself works. 

If ^e had chosen a four-part model, such as the system elucidated fully 
by Kinneavy in A Theory of Discourse, we might have had a more exact- 
ing ^and theoretically satisfying system, but one that was tmnecessarily 
coyiplex for describing impromptu writing produced in 20- or 25-minute 
exprtises. Kinrieavy notes that the purposes of discourse may not only be 
self-centered, audience directed, and subject controlled, but they may be 
involved with manipulation of language for its ov/n sake, as in literature. 
Given time, one may produce literary language in oratory, advertising, or 
graffiti, for example; playing with words may represent a pleasantly sub-* 
^Versiye motiye which complicates any effort at writing, either enhancing 
, or inhibiting its effectiveness in coping with other goals. Fond of language 
ourselves, Klaus and I hated to omit evidence of interest in the language in 
the code itself, but we also feft that the practical limits of our methods for 
getting samples of prose made extensive examination certainly mislead- 
ing. We therefore judged playfulness in language— manipulation of lan- 
guage forms for sheer pleasure— to be a part of self-expression. That is, 
we deliberately chose a model simpler than one we might have selected 
on purely theoretical grounds. 

Perhaps, too, I should offer a practical caveat which is taken for granted 
by rnodel builders. Motives are rarely pure. We write a single piece for 
many reasons; therefore, our practical judgments about the effectiveness 
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of a particular sample of writing require the blending of the pure colors^ of 
the theorfetical system into the earthier shades of actual performances. For 
example, I write to inform you ^bout the system we devised, but I am not 
really trying to.avoid persuading you of its usefulness, nor am I conceal- 
ing Ae voices of the people who did the work and thus imposed their 
visions and conceptions on redity, nor do I ref use to play little games with 
the languagerln short* the sharp categories of our discourse model proba- 
bly must be blurred into coi\Bnua, a kind of tri-polar surface upon which 
we might locate any particular rhetorical situation in order to schematize 
the blend of purposes implied, so we can then derive what must be the 
primary rhetorical traits and the particular verbal devices which should 
be associated with the trait. ' 

Figure 1 depicts the model we actually chose. Explanatory, persuasive 
and expressive extremes -are 'represented by the .angles of the triangle. 
Each point is associated With the features of language ordinarily related to 
that goal of writing. For example, we view persuasive writing as audience 
oriented and therefore concerned with the appeals of classical rhetoric. 
Yet, we note that one of the traditional Appeals is to logic, and certain 
persuasive situations tend toward the explanatory point of the triangle. 
Categorical organization and explicit evidence are important in such sit- 
uations. Persuasion more dependent on ethical proof, on expressions of 
the character of the speaker, woiild be located more toward the expres- 
sive point of the triatigle and would be more concerned with the devices 
suggesting the "voice** of the writer. 

t - 

- ; Explanatory Discourse 

^ (Subject oriented) 



Expressive Discourse Persuasive Discourse 

(Discourser oriented) (Audience oriented) 

Figure 1. 




Figure 2 depicts a more complex model we rejected as more complicat- 
ed than we could*handle. Although the diagram suggests that transaction- 
akwriting (perlocutionary) can usefully be divided into referential and 
persuasive writing, it also implies that illocutionary writing can blur the 
distinction between expressive and literary discourse. I have tried to sug- 
gest alternative terms without worrying about fine distinctions in order to 
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imply liow categories in the model represent tendencies in related mod- 
els. 



Hlocutionary 
(Spectator) 



Expressive 
(encoder) 



Self 

oriented 



Perlociitionary 
High (Participant) 
personal (Transactional) 
involvement 

in situation . 
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(decoder) 



Literary 
(language) 
(code) 



Other 
oriented 



Explanatory 
(substance) 
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Low 

personal * * ^ 

involvement 
in situation 

Figure 2. 

• /■ 

Evalu^on: The Real World and the World of Tests 

The model categorizes discourse directly in terms of the purpose of 
discourses, so before trying to develop exercises for use in indirect testing, 
consider how we evaluate discourse directly. Exercises and scoring 
guides mus*^ eventually stand up as analogies for the direct experiences.of 
writing. 

In the real world, as opposed to the world of the testmaker, transaction- 
al discourse is judged by what it accomplishes. If one is trying to sell 
automobiles, the sales chart to some extent is a measure of the effective- 
ness of the discourse, although the facts of a malfunctioning vehicle or 
impoverished customers may cloud the issue. So too with all of the types . 
ol^persuasion outlined by Aristotle;' each can be judged by its effect, al- 
though each may be perverted by some exigency in the situation., When 
♦^he transaction is explanatory, as a set of directions or in a textbook, the 
quality of the expla'-ation may be judged by whether the reader is able to * 
carry on the procedures as directed. Even the ability tc carry on a discus- 
sion in .vhich the understanding of an idea is necessary^becomes-a test of 
the explanation. Put «^rrply, a transaction implies a response; if the reader 
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; makes the appropriate response, the writer has written, well. Not all situa- 
tions are equally demanding; selling a car to a bankrupt cyclist is more 
diflScult ilfaan selling a drink to a wealthy alcoholic, |:)ut each can be judged 
by a practical outcome. In the test world, nothing really happens, so some 
methoa of analysis and description must Jbe devised to replace the obser- 
vation, of the effect. j 

In the real world expressive discourse makes a writer feel better and 
know more— it is the language of discovery. Tp the extent that an^audi- 
ence is involved, expressiji^eness is shared language. We say that the an- 
other expresses our ideas. >Vhen James Kinneay (1971) analyzes the Dec- 
■>laratio n of Independence as a piece of R epression, which it primarily is, he 
Reveals it to us as if it were our own expression, if we were clever enough 
to have thought it (pp. 409 fiF.). That issue of expression foir the collective 
mind is now confused by the fact that the nation honors the text without 
reading it; we might speculate that many people would oppose it, if they 
vead it thoughtfully, for it asserts the value system of its authors and not of 
many current Americans. The same might be said for most revolutionary 
documents, Ipve letters, and barroom chitchat. What happens is probably 
internal. Even if a revolution or a barroom brawl is generated, the expres- 
sion is responsible only to the extent^at it helped each participant find a 
jform in language which enabled Kini or her to discover personal beliefs. 
/These individuals were not persuadjed; rather/ they found, borrowed, or 
/.stole a form for their own inchoate feelings. With some qualifications, as 
much can be said to define literature as the language of formation and 
discovery in symbols. Eveii in the real world it is difficult to judge expres- 
sion. Each reader speaks for one person. Some especially sensitive literary 
critics or psychoanalytic observers can guide the judgments of most read- 
ers, but even literary scholars prefer to describe expressive pieces as so- 
cial commentary that should be judged in„a world of transactions. And 
since the aims of discourse are rarely unmixed, such evasions have merit. 
In the test world the difficulty of dealing with expressiveness has often led 
us to pretend that it doesn't exist. 



Developing Exercis^ 

< 

Perhaps I have eased into the second step of using Primary Trait 
Scoring— devising exercises which in fact stimulate respondents to write 
as well as they can within the narrowly defined kind of discourse to be 
examined.' For all holistic testing, any exercise must be within the legiti- 
mate range of knowledge of the writer. An exercise about farming penal- 
izes cky children, one about vacations favors the prosperous, and one 
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about making complaints will varjMn its power according to the writer s 
-so cial class, A s itu ati o t^-whieh-wil^befe^ne-^hiki^IUhreat^ 
and baffle still another. The results will reflect experience in situations as^ 
apuch as skill in manipulating language forms. A wide open subject, sucKv^, 
as that allowed in conventional^iolistic^oringrpermits^ each writer to 
find a personally satisfying way to respond, but in Primary Trait Scoring a 
stimulus must generate writing which is situation bound; The writer can't 
just do his or heip^own thing. The more one restricts the situation in order 
to define a purpose and stimulate performance of a particular kind, the 
greater the chances that the exercise will fall outside of respondents' expe- 
• riences. The testmaker must deal with the problem directly. 

Identifying the Kind of Discourse 

First, we must isolate the type of discourse to be evoked. On a theoreti- 
cal basis, we might want to sample all areas of the model triangle, and 
perhaps a person with a good command of tHeory and lots of practical 
experience in relating the features of discourse [o situations would mark 
spots on the model and create exercises to fit. Partly because we inherited 
exercises from the first round of the NAEP s writing assessment and from 
preliminary work dpne on the second round, we located existing exercises 
pn the model. We imagine that most teachers practiced in creating class- 
room exercises will also create the situation first. Then they can analyze 
the rhetorical implications, placing the exercise on the model; this will 
serve as an aid in discovering the features which characterize writing in 
the presprib'ed mode. 

Suppo:{e one begins vith a typical classroom assignment: "Write a letter 
to the principal sugge;>ting some improvement in our school." That seems 
to be a routinely persuasive situation roughly conforming to Aristotle's 
strictures about deliverative discourse. We might assume that a principal 
is a mature and responsible person who will respond rationally to a de- 
tailed, factual description of a condition which requires change, so much 
of the presentation^vill probably be referential discourse. A principal 
concerned about pupil^* feelings might respond to evidence of expres- 
siveness, but that would be a secondary consideration. We probably 
would locate the exercise fairly close to the line between explanatory and 
persuasive discourse, vloser to the persuasive end. If parents were the 
^udience, we might posit that a larger expressive dimension would be^ 
appropriate, and we might consider that the usefulness of wheedling 
jtvould push the exercise closer to pure persuasion. The specifics of this 
example, as in almost any proposed exercise, are open to discussion, but 
^ the issue for the testmaker is to try to identify the possibilities through . 



Primary Tfott Scoring ■ . , 43 

careful examination of the situation and any verbal cues in the assignm^t 
itself. So long as the assumptions are explicit, the user of the test can inter- 
.pret the results fiurly. 

Trials 

Preliminary trials of proposed exercises are essential to ensure that re- 
spondents will understand the situation ^ the designers intend. One does 
not expect a student writer to make a conscious analysis parallel to that of 
the designer, but the writer must understand the situation in such a way 
that discoune in the appropriate mode is'generated. The writer s duty is 
to perform aptly, but the designer's task i^ to create a situation in which 
that apt performance will illustrate the writer's competence within a par- 
ticular mode of discourse. 

The trials reveal whether or not the expected kind of discourse is 
evoked, and as importantly they suggest what kind of cooperation the 
exercise encourages. If an exercise happens to evoke consistently a kind 
of writing which the designers did not expect, they may simply recategor- 
ize the exercise to conf onp with what has happened, although they should 
attempt to rationalize the change. When we found that a hypothetically 
persuasive exercise abou^ women's place in society provoked mostly 
statements of feelings about women's place, we tinkered a little with the 
^ phrasing and tiius created an expressive exercise with an appropriate 
scoring guide (see pp. 60-66). We might also have changed the exercise 
drastically to require arguments about the Equal Rights Amendment— a 
more clearly persuasive situation— but that would have required our re- 
spondents to have special knowledge and probably would have distorted 
excessively our view of the quality of the writing as such. 

VMotivalion ^ 

\pne can never wholly separate the quality of the writing from the 
kno^wlcdge of the subject and probably should not try. Yet, if one is to 
leam^about a national sample of several age groups, and if by law one 
cannotv identify individuals or school districts, ti^ one has to get the 
cooperation of the writers without the implicit threats of bad grades or 
angry school boards. Part of that cooperation must come from giving the 
writer a satisfying task. Knowledge of the subject is part of the satisf^p- 
tioD. The obj^!c tjons made abput lack of motivation in writing for the first 
round of NAEHP^s writing assessment may have to be doubled for the sec- 
ond because Primary Trait Scori ng enforces restrictions^ hich may mak^ 
the tasks less attractive. . 
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S[tilly some illustrative observations about how the exercises affect moti- 
vation can be suggested. The more the ^stimulus includes material in* x 
tended to suggest prewnting instructions given in textboolcs, the greater- * 
the confusion. Each prewnting question provokes its own answer. In fact, 
each addition to the stimulus produces a possible distraction, and distrac- 
tions' seem to lessen the attractiveness of the task. Certain images areate 
trouble. ^^Bananas,** ..or example, seems to^provoke pornographic or scat- 
ological responses. Bill collectors seem tf^h^ exceedingly threatening to 
some people. When we tried an explanatory-persuasive exercise to evoke 
a serious letter to correct an error in computer billing, we got a number of 
amusing responses, but when we tried to revise the exercise to encourage 

hmnofotiniterary-expressiverespomes by making the situation more ab^ . , 

^ surd, we found that the increase in.tlie number who could joke about 
computers and over-due bilk was small and, strangely, the number whidi 
dealt effectively with the problem in serious, highly conventional terms 
became larger. In both versions a substantial number of respondents were . 
merely h ostile. 
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In general, expressive exercises seeme^d to draw more enthusiastic re- 
sponses than did transacnonal ones, probably because writing^expressive- 
ly is to some extent its own reward. Make-believe transactions present a 
mild contradiction of terms and that may tempt one to imderestimate the 
skills in handling practical situations. Especially for nine-year-olds -^Titing 
seems to be fun, but older students more often seem to view writing as a 
chore. Probably no simple answer to motivation can be offered for all test 
situations, but it should be a concern, and perhaps it would be wise to 
have uninvolved observers read papers and conmient on the seriousness 
with which writers approach their .tasks. la short, finding likely topics 
within the range of all the respondents and challenging enough to pro- 
mote serious efforts despite the lack of any **payoff" remains a problem. 
And a 55-minute test period is still only 55 minutes, so tests are limited to 
extemporaneous production. That does not demonstrate what a serious 
person might be able to do in occasions which permit time for reconsider* 
ation and revision. Editing allowed in a 55-minute period should not be 
considered revision. 



Scoring Guides 

The practical problems of devising suitable exercises would fill a hand- 
book of operational lore, but creating intelligible scoring guides without 
violating the chaste theoretical model requires patient labor, frequent trial 
readings, and substantial theoretical background—on the average, sixty to 
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. ei^tyj hours of profafsional time per exercise, noTcounting the time re- 
gofir^ to administertthe proposed exercise to get samples, nor the time 
. r^iiored tp try out tide proposed guide. Once the guide is created for a 
. particular exercise—and the guides are specific for each situation— then 
presumably any bright and verbal person can use it 
A $coring guide consists of (1) the exercise itself, (2) a statement of the 
, primary rhetorical trait of the writing which^hould be elicited by the 
exercise (a^di^d of statement of the limited test objective), (3) an interpre- 
V tatfon of the exercise indicating how each element of the stimulus is pre- 
;^^.suraed to.aflFect the respondent (a kind ofhypothesis about performance), 
:'(4) an interpretation of how the situation of the exercise is related to the 
posited primary tpiit (a synthesis of #2 and #3), (5) a system for defining 
the shortiiand which is to be used in reporting descriptions of the writing 
. (the acjtual sconng guide), (6) samples of papers which have been scored 
(defin^itioh of the score points), and (7) discussions of why each sample 
rpaper was scored a? it was (extensions of the definitions). 

Wfost of the guides of persuasive or referential writing use numbers 
(scores) which indicate a value placed on the observed performances. 
Usually 4 or 5 is a highly competent performance, 1 is a serious but quite 
inadequate response; other symbols are used to indicate a failure to en- 
gage the exercise. Since score points are defined in detailed discussions, 
Jy^e usual arguments about using even or odd numbers of scoring catego- 
,/ ries do not apply.. The middle number is not necessarily an "average" 
/ p^erformance. Excellent prose which is an inappropriate response to asit- 
/ uittion may well be rated 1; in some writing situations a top score might 
1 appropriately be awarded to prose judged to be nonstandard dialect. Ex- 
[ pressive prose often was described in terms of the kinds of response 
made— not presuming, for example, that either categorical or associative 
organizational systems were to be preferred, or even that lots of concrete^ - 
detail was ^elf-evidently better than well-knit abstractions. Simply, the 
score points mdicated what the writer did. Each score point is described 
; " in detail in terms oif what language features might be expected. 

Perhaps in an ideal world of brilliant rhetoricians one would know in 
advance the features which would define a 2 or a 4 paper, but we took 
papers gathered in trial runs, examined them carefully, to see what fea- 
tures actually were chosen to solve the rhetqrical problem, and then wrote ^ 
the descriptions to conform with the expectations established by the sam- 
ple. Usually, we found many quite legitimate solutions which we had noi 
imagined. We were delighted by the inventiveness of respondents and 
quickly learned that even highly structured situations permit a variety of 
appropriate responses. 
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Guides for some of the released exercises have been published by 
NAEP; one example is appended to this chapter. Anyone who wishes^ to 
use this method should undoubtedly read over several guides before de- 
vising ne>y ones. Each guide was cpnstructed by three people, one acting 
as secretairy for the group. Then it was given a feasibility check by an 
independent observer who used ^e guides to train readers. They, in turn, 
rated papers obtained in the original trials and previously rated by those 
who devised the guides. The reliability was judged to be at least as go^ 
^ais that obtained in more conventional holistic scoring, although^ thbse 
da^^eo^,^ better presented by the people who worked on them for^ 
NAEP. WritingTteport-.Q5-W-02 ("Expressive Writii^g") provides aijt ex- 
.tended discussion of the scorin'g^'of three exercises. ^ ^ ^ 

. ^ When to IJse Primary Traits ^ 

The questions about whether to use the method concern the conven- ' 
ience of development and administration, the validity, and the amount of 
information obtained. In terms of convenience for t he tester. Prima ry 
Trait Scoring is more dilOSQult than other methods. One hopes that the 
evident need for extreme carie forces the testmaker to develop a better 
instrument, but that airgument, I aitl aware, tastes like sweet lemons. 

For validity most tests of writing depend heavily on face values. Our 
usual decision about whether a given sample^f writing is to be judged as 
good, apart from situations of actual use, depends on the opinion of "(iWali- 
fied reviewers. If enough reviewers of various biases accept a piece of 
writing as good— especially if the reviewers live in widely -separated 
places over a period of time-^then the wiiting is accepted. Such judg- 
-frmnts^e riot niucK help tD7a"person who needs^vqufck repoit^n a large 
^ ^number of small samples^ As a result, the ETS m^^thod of searching jout 
/qualified*' judges and calibrating their reactions to a single reporting 
bode is a reasonable comproniise. To be sure, the validity of tkeludgment 
^s limited by the ability of the udges, and even under carefully planned 
scoring conditions, the judges rate in gross terms. At times one has the 
spnse that a household yardstick is being used to measure the diameter of 
a, cylinder in an automobile engine. To ensure high reliability, one must 
a^ept very broaden ges. Various atomistic tests may be correlated Jo 
such holistic judgjneins'Bncl^thus acquire the same face validity, althou^ 
necessarily there is som€' lossot^ialue in the transfer. Atomistic tests can 
also be correlated to other outcomes, such as sucT^s in college, but this, 
does not really provide a valid statement about skill in discourse. Primar/ 
Ti^it Scoring also depends to some extent on the face authority of the 




readm, but even more on the (competence of the people who make the 
exercise and the guides. A user )pf the test\an easily examine just what 
the testers thought they were exaniinfag. The l«t thiis. gains credibility in 
its openness. Not the authority of the reader bufAe persuasiveness of the 
•scdring guide beconn^ the issue.. \ . . ^ 

The &al advantage of the Primary Trait method ^he amount of infor- 
mation which cari-be taken from a piece of writing. To some extent one 
mu^t.lcnow less to know more. A sharper fbqus elimin^es some of the 
peimmbra of a general skill, but it gives a sharper view of 8\e complex of 
particular skills required to do a given task, and therefore ihcreases the 
BkeUhood thatwe.will,be:able to identify, strengths and weakrti^ses pre- 
' cisely. If we find that our respondents, in trying to persuade respmisible 
authority, do hot provide clear objectives, evident transitions, arid apt 
evidence, and if at ihe same time we find that our respondents are ab^to 
present vividly concrete narratives from* a first person point of view wi^ 
implied transitions (or stop-action associative connections), then we paji 
begin to make far more useful comments about their skills in writpg. 
Gi^ofed, we still need much stylistic study of exactly what features of 
langua^e^^e Decessary in different situations,: and until we have such 
work we^^ll^obably have. to create questionable make-do scoring 
guides based on^esqribing trial runs of exercises. Still, urjless we focus on 
one type of discourse ata^e, we will be limited to a vague global viey/ 
of the moon. The Prmiary Traitmethod doesn't offer an immediate shut- 
de rocket to descriptions of writmg,^but it does suggest a research tool 
-^v^rhich might permit more persuasive conclusions than we have yet been 
able to ^reach. ' . "^--^ 

APPENDIX 

To suggest the process ^f evolving adequate Primary Trait Scoring 
glides we are appending scoring guides for two v^aiting tasks. For one of 
the tasks (Children on Boat essay), we are including an early draft of a 
scoring guide and the revised, final form. For the other ta^k (Woman's 
Place essay), we are simply including the final scoring guide. Both guides 
^tDgetheA illustrate the possibJities of Primary Trait analysis and scoring. 

Writing Task: Children on Boat 

-* Respondents were^given a printed photograph of five children playing on an 
/ overturned rowboat. The picture is copied in NAEP report 05-VV-02. -'Expressive 
Writing,** along with adcJiHonal reports of the scoring of the exercise itself. The 
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Jtask'was presented tc/a sample of ages 9, 13, and 17 in 1974. The actual task and 
the original draft of the Scoring gukle. are reproduced here. The final scoring guide 
given to raters follows that. These guides ,do not appear in the report. 

Directions: Look carefully at the picture. These kids are having fun jumping on 
the overturned boat. Imagine you are one of the children in the picture. Or if you 
wish, iipagine that you are someone, standing nearby watching the children.. Tell 
what is going on as he or she would tell it. Write as if you were telling-this to a 
good friend, in a way that expresses strong feelings. Help your friend FEEU the 
experience too. Space is provided on the next three pages. 



NAEP Scoring Guide; Children on Boat 

Background 

Primary Trait Imaginative Expression of Feeling through Inventive Elabora- 
tion of a Point of View. 

Rationale, The test is whether a writer can project him/herself into a situation, 
find a role and an appropriate audience, and then reveal an attitude toward the 
material in relation to the role— a complex writing task. The picture is full of infor- 
mation; as in life, there is more information than a writer can use; the writer mmt 
choose appropriate facets of the situation consistently to serve a purpose. As in 
any photograph, time is arrested, so to explain what is going on, a writer must 
invent circumstances consistent with what is given. Weak writers will be tempted 
to explain the details separately, if at all; perhaps because a weak writer cannot 
really get into the situation, he or she gets no sense of the whole. A strong, well- 
elaborated point of view will relate and control the events. 

Note the important features of the instructions. "Look carefully at the picture." 
The writer is expected to study the facts, to perceive detail, but if he or she has 
trouble getting going, the observation that the kids are having fun jumping on an 
overturned boat will help. "\ 

Then the writer is given one of two roles— that of a child in the picture or that of 
a person nearby Whe latter may be child or adult. It is also possible to have either 
role filled by a person writing much later in reminiscent response to the picture, 
but the writer is still expected to maintain a personal relationship to the events of 
the picture. 

Finally are the three verbs of crucial instruction. "TdC' "Write." and "Help." 
'Teir' suggests an oral manner, although it probably does not require it. but "as he 
or she would tell it" provides additional pressure to be natural. In fact, it encour- 
ages role playing, a strong "I" \oice. and that can cause some difficulty in reading 
papers h> mature writers who are trying to imitate children. Probably those who 
attempt extremel> difficult poM of view problems should be read leniently, be- 
cause they are demonstrating notable competence. The second verb introduces 
the "good friend," an instruction that may encourage dialogue but impHes that a 
cnicial element of strongly realized point of view is an audience to which one 
directs a tone. This too may invite private jokes, and sometimes the overt conces- 
sions to audience may be missing, yet 'T' requires "thou" so the issue may be very 
iniportant The issue of feeling finishes the second verb and occupies the third 
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(which makes another reference to audience) so one expects a governing 
emotion tp imiSfy the papar— the "I" is defined at least in part by attitude (feeling) 
toward the materials of the picture. The selection and ordering of detail, and the 
invention of self, tone, and attitude should make the best papers highly stnictured. 
So m uch control in 20 minutes is outstanding, so we judge that even apapar'which^^ — 
maintains good technical* control and order with closure is still excellent. 

Qhriginal Scpring^Guide 

Rubric. 

' Non-rateable. Does not refer to the picture at all. 

The paper could have been written by someone who had not even seen the 
picture. Any paper that refers either to five children or to an overturned rowboat 
(or to both)» no matter how minimally, must be assumed to h~aVe been stimulated 
by the picture^ therefore if is rateable. Any paper that does not refer to eitherof^ 
those elements must be scored iis non-rateable because it then invents Its dwn'"^ 
problems and is irrelevai^ to the categories of this rubric. 

L There is no real entry into the imaginary worUi of the picture even though 
there is enough descriptive information to prove the writer tried to address the 
issue. 

Technically, most of these papers are incoherent, that is, the information does 
not stick togedier or drive to a particular point. Details or bit>,of information may 
be named, but do not fit into a situation; lists of observations do not reveal a per- 
spective. There may be relatively few lapses in temporal or spatial point of view 
because the writer attempts so little, although it also is true thai notable confusion 
of technical point of View justifies a "1." Some papers may be quite long, but they 
represent mere description of the picture, repetition, or irrelevant speculation 
Others maybe too brief to create a^world. The writer may possibly name a read- 
er, as suggested in the instruction, but no definition of mforiiiation 5feems to result. 
Some merely remain as observers of a photograph. 

2. The writer accepts the world of the picture and thtv^ hiLs an appropriate and 
identifiable point of ttew, bnt is unable to create any structure to his/her presenta- 
tion of that world. The opposite of this can also be true. That is, the writer has 
cheated structure but his/her point of view is either inconsistent or flawed in other 
wa^s, such as temporal or spatial. 

The data in "2" papers may permit the reader to construct an organizational 
pattern consistent with die point of view, but the writer leaves the pattern to be 
inferred. There are restively fow inlernal transitions expressed. Attitude may be 
stated but not illustrated; narratives may be suggested but not worked out; theses 
may or may not be stated, but they don*t control much; in short, the writer enters 
the world of the picture, but Ls not sure where he or she is. As a result the writer 
may cite details which don't actually contradict but don't really harmonize*— 
clusters of perhaps-related notions that don't make a whole. He or she may invent 
incidents obtside of the picture without relating them to it€?ms in the picture. Of- 
ten there are errors in technical point of view— tens(? sequence, for example— but 
these are symptoms of the failure to reveal the writer's place in relation to correct 
sequences in nonstandard dialects of English. Issues relating to dialect are not part 
of this rating, so scorers should be cautious in reporting as failures what might be 
alternative forms. 
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These pajim are generally competent in creating a realized point of view 
tovoard the world oj^lie^ 

^e temporal and spaRaHpoint of view is controlled, expressed in strong leads 
nx topic sentences or transitions, 4>ut the d^elopment is uneven. Elaboration is 
flawed, and the attitudejnay be merely named instead of presented to "help your 
friend feel,'* perhaps because^details are iriadequate^ excessive, or unclear. 

Narratives, if used, are sketched in (more than suggested) but still are left wth 
gaps or other unevenness. Theses or attitudes may be named, and somewhat sup- 
ported, but do not govern tKe whole paper. Excess dfetails, if they occur, are a 
,flavy when they don't in fact aid tfie pattern, feven if they don't obscure it. Some 
patterns, however, encourage invention well b,eyond what is actually in the pic- 
•ture. . ' 

Nofe: The scoring ?)f c^egories 1, 2, uiid 3 must be done on a main thru^C^l^is. 
That is, the paper that contains mere description of the "1" category canbecumfe^ 
~^2** paper later on in it. That is to say, that some writers write papers that move 
from one category to another— they are not neatly^written in just one category 
(some essentially "2" papers can contain a whole section that movesjt into **3" 
cat^ory). Therefore tf the paper is mainly a "1" ("2" or "3") with some elements 
of another category, thepaper should be scored on >yhat the writer has mainly 
done. This consideration does not arise in the "4" or "5" categories because **4" and 
**5" papers must be jflruQturally whole. 

4. Temporal and spatial point of view sustained by consistent narrative, or atti- 
tude, developed by evocative^etait,' representing a strongly felt' perspective. 

These papers are neat— loose ends have been tied up or cut off. The writer s role 
$ evident; he or she probably Is able to cteatejhe role without even making-an 
exQiCitsssueof the relation to the audience, but atthe-sanielinie shows concern 
for his or h^Sltitudes and ideas in C9ncrete terms. The papers often have closure, 
although a strong paper without closure can still be rated in this category: 

5. These papers have all the neatness of a "4" and shape the facts of the situation 
into a highly structured^ inteUigeht statement. The statement can be positijge or 
negative and can be accomplished through controlled as well as through explicit 
interpretation. 

These unusually mature papers represent a persp&tive that fuses emotion and 
V intellect into a single statement. If narrative order is chosen, the story will suggejst 
^^meanings beyond the ev:jnts themselves— not as a tacked-ot: sentiment, but as 
integral development. An essay will show a strong interpretative intelligence. 
These papers are likely^o-present ideas implicitly rather than explicitly, ; 

Notes: •*3" is not the midpointof a five-point scale; in this rating "5V is exception- 
ally good. **r* and **2" represent failures to realize point of view; "3" and "4" re- 
, present degrees of success, "5" is a rarity of success mostly to be found among 17 
year olds and adults. ^ 

Strategies and Devices. Although point of view is the trait being examined, this 
trait can be perceived only in rpference to the information presented; therefore, 
especially in good papers, a rater may seem to be judging the quality of the detail. 
Such quality is determined by how well it extends and confirms the personality 
and perspective of the writer. The imagination is required in order to conceive of 
the perspective and to select and invent details frtm the picture ^nd its implied 
antecedents so that a feeling is expressed. The object of thfe secondary descrip- 
tions for this item is to identify the strategies by which the point of view is made to 
operate. Although particular choices are not necessarily better than others, some 
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devices allow the writer mom options and therefore more complexity in express- 
an idea and more fuUness in realizing a situation. 



First identify the speaker as one of the five children shown in the picture or as an 
obsefver. We will count an adult recalling participatiom as one of the children as a 
child speaker; the distinctions can be recorded in the next item. The issue is that 
the writer records his or her experiences directly. We can hypothesize that speak- 
ers dealing with their own experiences will be more precise in controlling point of 
jge ^arkj ^orO. ^ - • 

h-RQint of vieuN)^ one of the five children. Tpis also includes papers in which 
the writer says, "If b^^e one of the five childr^." In these papers the writer is not 
. clearly one of the chUHr^-bu^ he/she is attempting to tsJce that point of view. 

2. ^oini of view of the observer^This category also includes papers in which it is 
di£Bpdt to tell which point of view is being taken. 

, 0: 6pth of the above. These are essentially papers in which^the writer has 
misunderstood the directions to take either the point ot view of the children or of 
the observer. Usually these papers are two separate^essays— one in which tb3 wri* 
ter has assumed a child's point of view, and one assunTing anDbservei;^. , 

Note: When an observer joins the children in the play, the point of vie^iOlill'" 
**2** because' the observer makes a "*6th" person playing and therefore is not one of 
/ the original five. ' , . 



DescribiD'j the events as they QccUr is more likely to result in immediacy, al* 
though it also may introduce various kinds of complications in transition and de- 
velopfnent. Mark either 3, TH, or 4. 



3. Viewed from present. If the point of view wavers in time or crpat^lPpresent 
frame for past events, then *'3" should be marked. If the presenf tense\3Qntrols a 
of the paper, we can assume a desire to creat^lnunediacy. M^e absence of 
the past tense market(-ed) is not, in all dialects of American English, evidence of 
^ present. tense, £p i^eaders should be careful to observe adverbs as well^ affixes. 
^ TH. This categofyJs for *'time:hypptheticar papers. These are papers that are 
written entirely in the "*If J ^ere on the boat," or, "If I were an observer I would 
do — These papers often include future references such as *'When I get on the 
boat I^will do—." It should be stressed that this category is reserved for papers 
that never leave the hypothetical, as many papers contain some hypothetical 
structures but then settle on either the present or tho-past. Therefore any paper 
that contains something other than hypotHetic^l st;;^uctures should be scored in the 
, Jappropriate x?ther category. ' 
4.. Viewed as events in the past. 

Some^^vriters will choose a framing strateg}^ for some or almost all the 
^planations. Basically thjs^strategy calls for a doubled perspective on the events 
so the writer can deyelof>^an idea by implicit contrasts. Most of the writers will be 
other than one of the five children, and the frame will create their role. However, 
merely creating an outside self is not enough; the, writer must use the contrast 
betweeh'^his or her perspective and that of the children on the boat. Since we 
hypothesize that the simplest development would use a single perspective, that is,, 
anyone who has established a double point of view must also have established a 
single point— we suggest merely a "present-not present" marking of whether a 
frame exists. By definition, papers scored in primary scoring cannot create a 
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successful frame, although possibly a writer may be scored 1 because he has 
attempted a fr^me and simply confused the issue. 
5. Uses, at least in part, a framing strategy for the point of view. 



Another device of distancing the observer from the events is to create a fantasy. 
Most papers will probably deal with reporting the events and proyiding logical 
interpretations of what is going on. They might even try to create a sense of tlie 
pleasure of games (e.g., king of the hill) but the papers remain in the liter^world. 

Some writers wUl try to reproduce ihe game fantasies of the childreiTon the 
boat. Probably the most interring ones will be wholly set m a wo^^ld of pirates or 
shipwrecks in the childVmind, but others will use the frame to permit entr^ into 
the world of fantasy. This should be scored as "'present-not present." Merely posit; 
ing the fantasy is no^eno ugh. There n^ust be at least a bare minimum of elabora* 
Hon which allows the reador Jo enter the writer\s fantasy.. ' 

6. Uses fantasy as a device of extending the perspective. 

Anothet way to reveal multiple perspective is in the use^^f dialogue. Although 
casting the explanation as a drama would be the n^ost extreme form of realizing 
multiple perspective, even trace uses of a dialogue indicate an awareness' of 
different stances, so on a "present-not present" basis score?;s should report the use 
of a dialogue within the answer. Quotation marks are not essential; the clarity of 
audience awareness is. This is to say that a statement must be clearly intended as 
an oral statement for a listener, real or imagined. The statement cannot be 
speculation or any other remark that could simply be made to one's self aloud. 
' 7. Dialogue is used. 



Final Scoring Guide 

ENTIRE EXERCISE ^ 

0 No response, sentence^fragment 

1 Scorable ^ 

2 Illegible or illiterate 

3 Does not ref6r to the pictuie at all 
9 I don't know 

USE OF DIALOGUE 

0 Does not use dialogue in the story. 

1 Direct quote from one person in the story. The one person may talk more 
than once. When in doubt whether t\» o statements are made by the same 
person or different people, code 1. A direct quote of a thought also counts. 
Can be in hypothetical tense. 

2 Direct quote from two or more persons in the story. 

POIN r OF VIEW 

0 Point of view cannot be determined, or does not control point of view. 

1 Point of view is consistently one of the five children. Include "If I were one 
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of the children. . . " and recalling participation as one of the children. 
2 Point of view is consistently one of an observer. When an observer joiris the 
children in the play, the point of view is still "2** because the observer makes 

sixth person playing. Include papers with minimal evidence even when 

difiicult to tell which point of view is being taken. 

TENSE 

0 Cannot determine time, or does not control tense. (One wrong tense places 
the papecin this xategory, except drowned in the present) 

1 Present temc — past tense may also be present if not part of the "main line" 
of the story. 

2 Past tense— If a past tense description is acceptable brought up to present, 
code as "past.*' Sometimes the present is used to create a frame for past 
events. Code this as past, since the actual description is in the past. 

3 Hypothetical time— Papers written entirely in the 'If I were on the boat" or 
"If I were there, I would." These papers often include future references such, 
as "when I get on the boat I will." If part is Jiypothetical and rest past or 
present and tense is controlled, code present or past. If the introduction, up 
to two sentences, is only part in past or present then code hypothetical. 

Sample Responses. 



Categories 

Age Dialogue Point of View Tense y 

0.00 / 

IS Well we are playing a game of monsters the boy is trying to swim away but 
the monster grabed him hy fiie arm. The other boy is trying to get around the 
other monster and the mijnster is ready to grab him. The other girl sittingis 
drowning and gasbin for air. > 

17 The.jchildren are really having a fun time They are throwing it looks 11^6 
little stones into the water. All of us were laughing and have a great timej A 
friend and another friend got on each side of, the boat and started to jiunp^up 
and down. All the other ones got really excite4 and started yelling. The blond 
hair kid ahnost fell in when the boat started to rock. All of us laughed. We all 
had so much fun we were trying to keep our balance but it ^yas reallv hard. 
The boat was rocking so hard that all of us practically fall in. I think most of 
them were relations. They never had so much fun and were fascinate^ by the 
the sights and boats we were the only ones there at the time whicnmade it 
good be cause we could lau^ and joke more we really had a fun dM I wish 
we could do thai again Ths time, I want you to come along. We haven't had 
this much fun in a long time. 

0 0 1 

13 Look at the children jumping on the boat. TheyVe balancing ^n'the over- 
turned boat. How looks like fun! We could make it a sliding boa^d and every- 
onecanplay. or tilt it and make a see saw out of it. Maybe if we^ coul.d turn 
it over we could put it in the water and go out into the lake, river, whatever it 
is. Someone could be a captain and the others can be passengers. Let's do it! 
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0 I 0 

13 I was having such a great time. It was as though I was doing something that 
no other kid was able to. As though I was older than 5 or 6. You should iry this 
sometimes. Its like playing house and being the mother of all those little kids. 
Even though we all are the same age. When playing some of the kids play like 
their70unger than me. Thats what I mean mostly by my experience, on the 
boat. I hope you can come and piay on the boat with me tomorrOiV. I know 
you would enjoy this as much as Mike, Cindy and the other kids did. It was 
really great. You can even pretend to be sliding down £ great big rock. You 
can come and create with us. 

17 Wow! We had the best" time down at the park today. Ricky Cindy Jimmy 
and I went exploring. We pretended to be Pirates who were stranded on a 
deserted Island. All of us were trying to Snd a way to escape from the Island. 
Then Captain Jimmy found a capsized boat on a derserted beach, at least we 
thought it was deserted, But ther a gang of enemy pirates came and attacked 
^us from all sides, but we hpld them back and used the boat as ^shelter against 
/ their swords and Guns. Of course in the end we won the fight. We were all 
/ overjoyed at the victory We jumped up and down and all around. Then we 
were faced with the problem of getting off the Island once more, but we 
._-__Mi!eX£n!t.djiimmies wc knew^thejother pirates must have had a boat! So we look 
all day long till we found the enemies big ship. Onward for home we all 
chimed in and we headed across the long wide ocean for home. 

But that was all, right by me because I was hungry Tor lunch ami I didn't 

want to miss the cartoons at 12:30!! / 

/ 

U 1 ■ I 

17 Jumping and running on ihe boat is very enjoyable. Up we jump dnd do wn 
we float. I feel as if I could sail the boat around the world and back. The salty 
sea air blows through my nostrils. My body feels engulfed in this exotic salt 
concoction The wind beats against niy cheeks 

The white, glistening, enamel underside of the boat feels like silk to the 
touch. The trees are alive, pulsating watching our childish games. 

I feel like I could play, forever. No concept of time, no responsibilities, no 
stresses encourage my exuberance. 

My body has separated from my spirit. I am no longer encaged in a prison 
of bones and skin. These are no barriers now. I can do whatever I want, 
whenever I want to do it. > 

0 1 2 

13 Cindy, youll never believe what happened yesterday! Four kids and I went to 
a dock and we turned over a boat, all of us got on it and we were trying to 
kept our balience on it. after a while one boy sat down and started shaking the 
.whole boat. We tried to keep our palience. We all managed it. 

17 Yesterday when we were at the lake we had a grand time. Steve Lori, Sue, 
Jody and I had the whole day to paly. It was a chilly day so we didn't wantjq^ 
get in the water or fall in. While going-for a walk, we found at someone elses, 
at cabin on the dock an overturned boat. We jumped and played king of the 
boat wh|Iing we were struggling to keep from being pushed in. This was 
difficult because as we moved the boat would rock from side to side. It was a 
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deter toter rolling log. King of the mountian gone. Stevie won. becauce he 
was Ihe only boy. 

Hut he.got m lots of trouble because he pushed Sue in. Even if he did win, 
wii|hing isn't rewarding when he had to end our fun in such a way. 

/ . • ^ 1 3 

9 I would tip the Boat over and push it in the water. And th«n 
I^would go for a Bide. 
I would jump in the water. 
I would Push it in the water while evey Body. 
' I would push evey Body off the Boat. 

0 2 0 

Well, five childi en are standing on an over-txirned boat. All of them are 
having fur jumping and hopping on it. It was a pretty windy day and the girl 
could have fallen in the lake. I thought one of them was going to hurt them- 
selves by jumping and sprane their ankle. Three boats are tied to a booy in the 
lake. 

13 Me and some of the kids were at the lake the other day. We saw some little 
kids playing on an overturned boat. Some were falling and slipping and slid* 
ing. It was fun to "(^atch them. TTiey acted like clowns. There were six boats 
and a house behind some trees in the background. On the other side were 
houses between some trees. There were two girls and three boys. The girls 
were wearing coats, one had a bonnet on. the other had short pants. But the 
other had long pants. The boys all had coats on. 

17 This happen yesterday, their we five kid on a boat, they were all having aiot 
of fun and if you were there you probaly you play with them. Like they were 
jumping up and down and make believe they were sailing it upside down. 
/ They were like jumping off and on. It was very great to be so small and do the 
same thing there did. 

; 0 2 1 * 

9 The children are on top of the boat walking around. They are trying to bal- 
ance themselfs so they won't fall. One of them is balancing sitting down on 
the boat. 

13 Look at those people on that boat. One is acting like he is on a horse. The little 
boy is jumping up and down. One girl bending over, the geggest girl is watch- 
ing the other girl who is bending over. The other boy is also bending over. It 
se^es like they are acting like they are on a boat in a st6rm on the sea. One the 
side of the laJce. 

17 the kid are haveing fun playing on the boat, keying to see who can walk on the 
boat without falling. The child siteing dpwn is rocking the boat to make it 
even harder. 

0 2 2 

9 There were five children as I see, and they were all jumping on an over turned 
boat. I was standing about 50 feet away. They were all having so much fun. 
One was kneeling, one was jumping, one was running, one was standing still 
and one was bl ,v ing herself from falling in the water. I wish so much that I 
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was there to. Because they were having all so much fuh» and I love jumping 
on boats. ' * 

13 Tljese five kids were jumping on this overturned boat. Well I was just stand- 
, ins there watching^them, when this little girl fell off and hurt herself. It was 
! not bad. When the'kids have left the boat I went over to th» boat and looked 
at it. It had wholes^and dents in it like I have never seen. I carried the boat to 
this boat fixer and he tried to hx it. Then he told me to try it out. So I put it on 
the water, got in it, and started drifting. Then sudenly it sunk with me. I got it 
out then looked at it and I seen it had a whole in it. I took it back to the boat 
fixer and the patched the whole up. Then I went back to the dock and tried it 
out and it worked good. The next day the same kids had turned the boat over 
and started it. I was disscustd 

17 I saw these kids on a boat one day^ind I mean they were really freaking out 
on this overturned boat. I mean tlioy Avere having the time of their lives on 
this thing. I really don't know what they saw in it but it looked like fun. So I 
kicked them off and played on it by myself for 3 hours. Then they came back 
and kibked me off. So then I jusf watched. They were hopping up and down 
on this thing. I couldn't be how much fun they were having on it. I mean I was 
there for 3 hours and had the worst time of my life on the stupid boat. 

0^2 3 
9 I would feel very sad because I couldn't play. I would also feel lonley be- 
cause I wouldn't have any: one to play with. 
I would wish I had someone to play with me. 

I would a?k my mom if I coult play ^nd she would say yes and I would be 
happy and when I asked my friends i^ I could stay they would say yes and I 
would feel even happier. 

1 10. 
9 One day we was at the shore. I and Jim, Chip, Brad, and Bill We was play 
on an over turned boat and we was pretending that we was pirates on an 
stonny sea and was ship wreack and the life boat tipped over and we was 
I waving for help. When we got back on shore we told everyone what hap- 
pened there then we pretend we was on an little island on the coast of Mexico 
and the little boat was the island We was waving for help. But we had to 
spend the-night there just like I figured. I told them we shouldn^t have gone 
that far and I said I knew it-I knew it!! And so when got back finnally we 
was not glad we wanted to pretend to visit another island like that so we 
pretended that we were stranded on another island and we were pretending 
that the over turned boat was the island again this was a far off island anmed 
Parkerson we like that island very much, even better than the other one we 
pretended at was better we had lots more fun. 

13 Boy, today I had fun with my friends today. We were playing by the lake on a 
boat that was turned upside dov/n. Christie almost fell into the water because 
the boat got a little wet. I just managed to grab her by the coat! I didn't know 
it but I stepped into the wet spot and I slipped too. Caye managed to grab 
MP: by the collar of my coat and she practically chocked me to death. Hut she 
still got me up. It was a pretty funny scene bocayse while she was pulling me 
up I was hauling up Christie. 
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After the excitement died down us kids were pretending to be pirates. We 
couldn't play it very good the boat was turned upside down but we nianaged. 

Little Johnny wanted to be the captain so we had to let him .or else he 
would have cried, and I don't like that! Before we started playi'^.g pirates I 
had to take Christie home so she could get some slacks on because she had on 
only short and her leg were so cold they were turning red. With that water, as 
cold as it was Christie was lucky she, didn't fall into the water. 

I'm glad the guys waited for me and Christie because I was the pretty little 
lady that gets captured by the pirates, and they are going to make me walk 
the plorikl But I'm not really going to jump into the water. I thought Little 
Johnny was a great chaptain but I'm sorry we had to stop playing because our 
mothers, called us to come in and have supper. Well probably play pirates 
tomorrow and I hope to be the pretty lady again. The End 

. 1 ■ I 1 

13 If I was jumping on a boat?l would tell my freind. It is very fun jumping up 
and down on the boat. Sometimes when you jump hard enough it take your 
stomach. You can s\vik on the boat. You can play games on the boat. You can 
have on slick shoes you can't hardly stand up. If I were one I would take otf 
my coat and put it down on the boat and let us take turns pulling each and 
other on it. Or I might just get a pair of skates and skate on it. You ort to try it. 
It is fun when you have some of freinds with so there can be more fun. It is 
more fun with freinds than by yourself. 

1 1 2* 

9 There were four other children besides me. We were all jumping on a turned 
over boat^ I fell in the lake. The water was shallow. The other kids started 
laughing at me so I pushed them in. When they came out I laughed at them 
and I said I got you back. Then we all started laughing. We started watching 
the boats. We had a contest on who could jump the most and then jump into 
the lake the farthest. 

17 Yesterday Pauls Dad bought a NEW boat. He took it down to ^ cabin on 
Lake Chelan and took us boating, we asked if we could take it out on the 
water alone. Paul's Dad said no, then he pulled it ashore and turned it upside 
down, so we wouldn't (or couldn't) put it back in easily. After Pauls Dad left 
ore of us got onto the top of the boat, it was very slippery and hard to stay on 
but after a while (and a few bruises) we all finally mastered it, except for *'ole 
weird Harold" he just sat on the end of the boat a flapped his arms l&e some 
sort of bird. We played all sorts of neat-o peachy-keen games like "King of 
the boat top" **I can stay up longer, than, you can" And "Ha Ha You can't 
knockmeoff'causercanstay on longer" ButallinallitwasrealB-O-R-I-N-G. 

1 2 0 

9 Tney are having fun jumping on the boat they might be playing boats and got 
caught in a storm and they found an un explored island and they were far far 
from any other land and they tried to make a boat to get off the island and the 
boat fiiped over and thats why there are standing on the beat like that tring to 
get back and one of them said, "lets swim back were 5re not ver>' far so they 
swam back to the island and tried to Make a fire out of twigs so they could dry 
out and that was a real problem but they had more problems than that there 
were indians on the island and were ready to attacV and if the people 
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•A>ere attackeil that would be the biggest problem to the people.that just came 
back and they were real tired and couldn't move very fast and thats why they 
are jumping up "and down. 

13 There was some kids jumping on a overturned boat. Boy how I wish 1 was ^ 

playing wjth them they were having fun if I was there I v^ould of had lots of 

fun. I hope none of them gets hurt. I like to see kids hav^ fun. It's better than 
getting in trouble. What If the owner of the boat comes and see them playing. 
I hope the boat dosen't go into the water and then tips over. I hope that girl on 
the end dosen't fall into the water. 
Good-by kids see you tomorrow 

1 2 L 

9 they are paying on the boat I wish I could play but I had my good clothes on 
my mom said don't go out and get dirty she said watch them play on the boat 
^hey are haveing lots lots of fun we a'^e going oul to eat one h6y is jumping ^ 
onther is seating on the boat 
the End 

V 

^^13 You should get off tha^. boat because one of you might get hurt, or the boat 
may fall in the water and you all might be KILLED.or something so lets pot 

play here and lets go some where more safe for no one can get hurt becaust 

that happened to me and it isn't no laughing matter I could have been killed 
so lhats why I don't want none of you to share my experence so lets legve 
before it Does Happen because I dpn't want such young kids to die so early in 
Life 

17 See that little girl standing oxk the end of 'the boat? Thats my little sister. 
Beth. She looks like shes having ^ fun time with her friends. They all live 
around here and are all very mischievious. They are always ge\ing in trouble 
for the things they do. Theyre not being mean or ugly or anything, its just that^ 
little kids, being little kids sometimes get into things they should nt 

Actually, they should'nt be playing on top of the boat because theres mud 
all around the boat and any minute one of them is going to f sJl off the boat 4c 
into the mud, but they have to fall off the dock before they get to the muu. 
but it won*t be long. ... 

I knew itl There they go. right off the dock and into the the mud. (chuckle. 
Chuckle) c 

Bethl You'^ better stay out of the mudi Mom'll get mad! 

One thing about kids though they can never stay clean for long and never 
mad at each other long. Why. just yesterday Beth and Bobo got into a fight as 
to who should be the princess in the game they were playing. Beth and Bobo 
finally compromised and said the could be twin sisters and they were happy 
then. .'^ 

Are kids great? 

Tommy is a happy kid. He always is happy and is always busy doing some- 
thing. Tommy. Beth. Tim and Bobo always through the football around or 
play tag together. Usally its just the four of them but a new boy just moved in 
the block so he's started hanging around with them now. They all have a good 
time and usally amuse themselves by doing the simplest things. " .. 





1 , -2 3 , \, , 
i7 I would of said fjet off that boat if he wouldn'tof got ofF I would go over there 
;-, and.g>;ihj!n'offlI hate to see anyone get hurt. But I wouldn't let any of my 
\^*nds" g«W. v .• v-^ \ 

' X. \ 2 \ r '0 ; \ 

9 We arc feiv^ fun oh the boat^v What if I mother catch us playing on tli^e boat. 
But we mii^bfall in1[h^ lake and my mothj^-vvtillJcill h^elf. I am going 
before Hall in tlSH^ce. Vou^chidjen and th^kept on melingis^o one boy fell 
in the lake^^nd got dra^dearAusth^x>thers kid ran home crying and they 
mothers ask &^ whats ^<^g my^riend^ fell in the lake, you^ did'i have 
any buines down lam going to^whoup you when^your daddy gets here. I am 

\ going to tfiULbill an^for him to whqupyou^again. Mother please dont let 
daddy whoup li^e. I wdnt do it any more^en I will ponish yoM. Alfthe other 
Icld didi't get no.whdupen>-They got to go'back and play. \ 

. N 2 '^^ ^ 1 \ 

17 Whee, isn*t this fun. Lets imaging A^eVe outcast pirat^.^ump for that\ail, 
tie the brigging. This is our faithful ship, s«dling over the tropical seas. Feel t^e 
strong, salty-^/^'in^whisking over your faceHcan almost feel the waves mov; 
ing under our feet. Now all jump up! There weiust missed getting dunked hy. 
that big breaker. Hows the weather up their at the top of the crows mast, Jack.^ 
Just fine? Good^ Now lets be off on our way on anotner^d venture. Lets go to 
the arctic this time. Bu, its geting mighty^ cold now. LooJ;! Theres a giant 
whalet Lets spear him and take it back to our homeland. I can even hear its 
_^heaving lungs. Closer, closer, now. Good, we got her. Pull her in. What, she's 
pufliHiFus. Hold on! Pull harder! Wow, we're gaining speed. Wheres she go- 
ing to takeus? Whats going to become of these poor lost souk in this perilous 
situation. Weil stay tuned to thisprogram, next week for further adventures. 
Same time, same shannedl See you now; this is the hearty Kaptin Kidd signing 
off now! And remember, if you bad breath and rotten teeth use goopy. Goopy 
brand tooth paste is the most fantastic product now on the market. If your 
eyes look kind of soupy, use goopy. 

Now that was fun, what shall we do now. Sail for fantistic Australia well its 
off now! 

•2 12 
9^ !-am going to tell about if I was on the top of th boat, playing, one day me and 
my friends went playing there were six of us and we wanted to go down to 
the lake and so we did we went Down to the lake and we saw a boat and it 
was tiped over and they wanted to go play on it and so they did But I told 
them not to But they didn't Listen so I Jiist went on wsfflcing But then Sandy 
Shelly Sherri Kim and Renee called out to me and said hey Lori come on so j 
went over there and said ok But just for a Little while and so I Just played f of 
a little While and* then I said I am going to go home now and I said to my 
• friends hey you guys are you comeing 

and they said okf'and so we went home and we were heard something and 
the boat fell in and they ran to see what happend and I said tp them see If you 
didn't come you would of been in the water come on I said lets go home and 
so we went home and they never went^own by the 1^^ by there selves and 
heather did I ^^-^ — 

T^ie endl--^ ' ' ' ^ ^ 
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' ^2 • 2 ' ^^■^^ 
TheseHdds are jumping on a boat. I said'be careful." You might^get hurt. 



\ 



1 

S These'icids are jumping on a boat. I said be caretul." You migfet.gethurt. 
D(^n*t pusm^^erybody could have a chance. Take il easy^^hy donTyou- 
waint him to pbi^oo. He could play. If you couW play he could play I Why 
don t you ask hin^^i^ou won t ask him I will. Do you want to play^I ca pt my 
^ 1 mother do nt want to |4^y with people I do'nt know. Where is you iTiother. 
Sh€\ is over there. Til ask {fei;^ould your son play. Would you take care of him. 
Surfe I will take car of him. C^djie could playl Thank Youl Do you want to 
play jumpingl Okl Kids you gonKnew freind! We do! His name is Johnl 

^ 17 Sunday afternoon I was taking a walk aloilg^he lake and I came across five 
\ kids jplayihg on an overtiuned boat. I stopped to >yatch them, and they were 
Y \ having so much fun I wished I was one of them.ltjeally took me back to 
\ wheij I was little, those days were so carefree. At fiKt^^hey were playing a 
^ modified version of King-on-the-mountain, modified to fit the boat. One boy 
\was a little bigger than the rest and usually was ki/ig, except he lost his 
, f^iaanqe, qr footing. As young children usually do they soon lost interesjin this 
g^eland began skipping rocks across the lake to see which one coula^e^ft 
to go jhe farthest After the "victor" was established they went on to a gamel 
never ^een anyone play before. They turned the boat upright and did a so^ of 
dance inside it. I have no Idea why they were doin^ it but it was fun to w^tch 
all the jsame. Finally they tired ^f flaying with the boat and started pla^jing 
**Ring-i-round-the-rosie*s*'. Now\this was a game I cotild understand, arid I 
longed |to be part of. After abouf^S minutes went by I finally got up enoogh 
CQurage to go and ask them if I C(>u!d join them, they said sure so I did. ^nd 
you know I don't think I vc had so much fun in years! \ 

1 2 2 3 , \ 

9 I would. go over to them and ask them if I can join them and I would ask them^ 
what thl»y are playing I would play that game with them we 
would have fun playing with each other. I would say be careful you might fall 
and hurt; yourself They would say we are playing a game and we are having 
alot of iiin playing the game with each other. 

\ '""r^ ---^^ , 

•Writing Task: Primary Trait Scoring Guide for "Woman s Place" Essay 



\ 



(f\c peoplt^ believe that a woman's place is in the home. Others do not. Take 
ONE side of tl^is issue. Write an essay in which you state your position and defend 

it. \ ; V^^^ ■ ■■ 

ENTIRE fiXERCISE ' 

0 No respbiise; fragment / 

1 Does not tiike a clear position, or takes a position but gives no reasons 
RestatementVf stem ^ ^ . 
Position giyeiAlhen abandoned , - ' 
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Position confused, or not defined at aU'^* / 
Position giyen, no reasons f or it \ , , 
Note: Taking a "^middle of the road"* position is acceptable 

If a lady w^ts to work she should be able to **cos of womans lib. 

.A..S^;Q!Il§ns place is not at home liecause I know shp wouldn like to be at 



home all the time douiigTiousework everyday, but if she has kids she would 
have toipay somebody to watch them, that's if she had a job. 

\ ^ \ ^ " . 

I belieye that a woman s place is m the home. Women need t^o stay home 
and take^^care of their )iouse. If a woman has children she should be home 
spending time with the kids. If a woman is home she has mbretime to clean 
. the house^ cook and prepare meals. I think the man of the house should be 
able to support his vyife. She should not hurt his pride by working. 

I think d^t a woman who have kids should be at home. The woman s^ld 
take carry of the home and the kid^ and her men. If the woman do not have 
any kids I think the woman can go out and get a job if she wants to. 

Women should stay home and clean their house. What I mean therebetter 
off at home Washing dishes washing clothes and etc. Some of the Women 
kno^ a days just want to get out of the house and want to know what's 
happening lately around their neighborhood, for that they should'nt have 
gotten marriral ^ * . 

In the mone>^ situation it doesn't really bother me if my husband gets more 
than ma It all goes to the same thing. If I weren't married and I weredomg 
the same as a man. I think we ^ould be paid the same. If we could do the 
same equal things. / < 

I believe that a womens place is where ever she wishes it to be just so she is 
happy with what she does and is good at it. 

I believe that a woman's place does not necessarily have to be in the home. 
-Women ^ho would rather pursue a career in a variety, of different fields 
should be granted tne opportunity to do so. They should not have to feel 
obligated toward becoming a good housewife if they hi»ve other interests. 
Women who have the intelligence, drive, and courage should use these qual- 
ities to become involved in any area of work they disire. Men must give 
them this ri^t. 



I think that a wonoan* s place is in the home. I don't think that women 
should have to work. Its OK I wouldn't mind it. If a women wants. to work 
which some do. Th^ts fine. But if you have children I think you should stay 
at home with them; If its necessary to work then I guess that you have to 
work. 



2 Takes a position and gives one unelaborated reason 

I do not believe that a woman's place is in the home^ Women shouldn't 
have to stay home aU day cooking and cleaning, just because they're women. 
All human beings should be treated e()ual and this includes a well-educated 
woman being able to work at a job» instead of doing menial housework tasks 
all day. 
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**A woman's place is in the home", also sounds to me me like to be a wo- 
man you have to be married. If women were.Vt educated and couldn't get a 
job then single woman would have to marry to survive? 

I velieve that the woman's place is in the home only when the man of the 
house is capable in providing a comfortable size jncome. I believe then if the 
man can't provide, the woman should go out and help this man. Abo a wo- 
man's place is in the home when there is little children, like from ages new- 
bom until let say 2 to 3 yrs. of age, when they most need the comfort and the 
^ love of the niother. 

think that a woman should do what she wants if she wants to say home 
-^Zshe can do the housework. If a woman have children and he husband is dead 
there is not another person in the house that can do any work so she has to go 
out get a job and do the be^t that she can.to^o to support her family. 

I -think a woman should work in a home becuase she knows want to do. 

I think thai a"'Wt)lrt^firplace is^at home. I don't think a women should have . 
to work in a factory unless i^eople don't have enough money to live on. A 
women should be at home with her kids. A women at work don't have 
enough time to spend with her kids, or her family and clean house like it 
should be. A women at work don't have much time to do what she wants. 

3 Takes a position and gives one elaborated reason, one elaborated plus one 
unelaborated reason, or two or three unelaborated reasons 

A womans place is not at home she has the same right to have a joD ana 
work. No woman should be at home all the time. Most women can do the 
same work as men. Some women are as strong as men. 

I say that this really depends upon the individual but I don't agree with 
_ r this statement. I feel that if a woman can \york and wants to work that she 
should. This way she can also help her husbaiid out with some of the bills or 
what ever. Also the women won't always have to depend on her husband for 
money to spejKion herself or him like for a gift. 

I believe that a womans place is not in the home. I feel that if a woman 
wants to work that this; is her right as long as she can take care of the children 
in the family. As long as a lady can perform her job adequelly let her work. 
Woman can be just as reliable as men, but they can't do the physical jobs that 
men can do. That is why I feel women can work and that their place is not in 
the home. If they can find a job let them work. 

I beilive that a woman's place is at home because it would be easier on her 
to stay home and clean house, cook the meals and take care of the children if 
any. A working woman is usely easiler to be tired or ran down and taking 
care of the home too. She might not even have time for husband or children 
maybe even her home by trying to hold down a job. She wouldn't have time 
to take care of herself as she normally would or to have kids. 

One should not generalize about "a woman's place" because like men, a 
woman should have the choice of her profession. Being a housewife is like 
any other full time job which should be chosen by the individual. Keeping 
women in one profession is like telling all men to do the same job. In this 
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way, our society would not be well rounded or prosper because of the im- 
balance. Women are human beings likf men and should be given the full 
right of choice.; 

I believe that a women should go to work. The money she'd make at a full 
time job would compensate for day care of her children plus leaving her 
money to hdp with -the weekly needs, banking account, or some other 
. emergency fund. 

I agree with the statement that a woman's place is in the home. For many 
years this has been a major social issue. Yes, die issue of women's rights and 
equality in a man's world has plagued us since Atom and Eve. I say that if we 
are to survive in the future the woman should stay fn their own domain 
wh^e the belong, in thb home. If a hard working man gets home and has no 
nutrition writing for hiAi, then how is he to live. If he cannot live and func- 
tion, then how will his jpb get done. And if his job is not done, then what 
about other men and (ti^ jobs. If this should come about then how is our 
strong nation, dependent on our men, going to survive in the future. 




I Takes a position and gives two or niore elaborated reasons, one elaborated 
plus two or more unelaborated reasons, or four or more unelaborated rea- 
sons \ ^ 

\ 

Women do belong in the house for many reasons. If women aren't in the 
house who would do the cleaning? If the woman went to a job everyday she 
would just have to give up h^ paycheck to restaurants for food, the cleaning 
lady, and to a laundry jf or h^ dirty clothes. If the lady of the house stayed 
home she'd probably do a better job cleaning her house because it is her 
own. Anything diat s your owii, you take better care of it. When the woman 
of a house goes to work it often puts great pressure on her to do all the 
chores of the house plus her joD. This coulil cause many family arguments 
and splitting of famOies. ^ 

If she didn t work, she could take care of the children, house, etc., but 
think of the additional income that she is missing. Fm sure jtnat if she had a 
job, it could very well cover the expense of a cleaning women, maid or some 
sort of house keeper as well as child care-taker. As lon^ as the woman is 
working, it relieves much tension and harder ,wo:k from^the other part (hus- 
band). As a result he might even be able to work as n^any hours as the wo- 
man or the woman work as much as the man. In either case, there would be 
a positive outcome at the end. j 

A woman's place is not in the home. Woman are human beings, it is their 
God given right to pursue what ever career they de^e. Life, liberty and the 
pursuit of happiness have been mentioned in tlie Declaration of Indepen- 
dence yet women have been denied their rights in this sexist^society. Not 
everyone wants to do the same job or pursue the same goals, must women 
be limited to a narrowly defined sphere of activity? No, a resounding no! We 
are people, human beings with as complex mental, emotional, physical 
. needs as men, a fact ignored. We are regarded as the second sex, the incom- 
plete sex, satisfied and made whole only by a family. And it is this false 
assumption shared by many men and women tc^o, fostered by the society we 
live in that has destroyed many lives because people were not allowed to 
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express the full range of their God given gifts and creativity. This attitude 
hi^ been, is reinforced at every turn and what seem to be the most trivial 
points are often the most telling because they "go without saying". A fine^ 
example would be that in filling out the front cover, we are identified as 
female by number 2. ITiese slights are equivalent to the demigration of 
Blacks in Westerns where the villains always wear black hats. 

7 Illegible, illiterate 

8 Misunderstands the question 

9^1 don t know; I don't wanl to do it; any reason given for refusing to write a 
response *\ 

Note: Score points 5 ^d 6 were not used for scoring this exercise. 
„.APPEALS I 

CONVENTIONAL WISDOM ' , 

1 Contains this type of appeal | 
r • \ 

. ' We are regarded as the second sex, the incomplete sex, satisfied and 
made whole only by a family 

People label her 

Even in the Bible the scriptures show that the woman is in the home 

Stereotyped as "the weaker sex", women have endured prejudice end- 
lessly 

I think this is just because the husband has always been known as the 
bread v/inner 

2 Does not contain this type of appeal 
PERSONAL EXPERIENCE 

1 Contains this type of appeal 

I'm not used to having my mom at home all the time 

A woman was promoted to seargent in the police, she was in the patrol 
car the a police inarv. A b:mch of ruff bys were loittering a patrolman got 
out and the guys startling beating him up the lady sergent sat in the car 
and just screamed 

I saw a woman driving trucks, buses even trying to clean off the streets 
and sidewalk 

2 Does not contain this type of appeal 

But I know that if I had no kids I would take a job to havea littl(M)f my 
own money 

AU'rHORITY I 

1 Contains this type of appeal 
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If Cod would of >yanted us to be the same he would of given us the 
strength .he gave men to do 

Many famous American authors have said woman can take life better 
than men 

Also, in recent scientific discoveries, the woman s new positioa 

2 Does not contain this type of appeal 

ANALOGY OR HGURATIVE LANGUAGE 

1 Contains this type of appeal 

Such duties should never be left for one person alone because that 
would be like a skunk in a daisy field— breaking up the beauty of marriage^' 

Russia is a good example of equality for women, more women are Doc- 
tors and women work in steel factories and do manual labor. Women are 
Road Repair workers. Russia sent the first Women in to space 

. 2 Does not contain this type of appeal 

HISTORY 

1 Contains this type of appeal 

Abo. look at the contributions Martha Mitchell has made. If she had lost 
her courage and remained a happy homemaker we would still believe 
everything Pres. Nixon would be saying and Watergate would still be a 
hotel, not an incident 

Taking the dilema in Israel, if the former premeir, Golda Mier had not 
' come out of her shell, where would this country be 

Suppose great women like Mary McLead Bethune had stayed in the 
home 

WonQien such as Marie Curie, a scientist, have helped a great deal in 
treatments and research in many fields of science 

History has shown that when a women- strays from home she gets her- 
self or someone else in troublej Look at Helen of Troy. She didn't stay at 
home and she starts a war j 

Mrs. Nighengale, she a fam(|us women in her days. Mrs. D an England 
school teacher taught at'the first public college 

If Woodrow Wilson s wife has stayed at home who would have taken 
his place in office, and Franklin D, Roosevelt must have thought his wife's 
place was by, his side because he asked for Advice instead of using the 
presidential cabmet for advice 

Women have been fighting for e<)uality for a long time and I feel just as 
sure about the subject as Lucretia Mott, Lucy Stone, or Elizabeth Cady 
• ^tanton 

2 Does not contain this type of appeal 
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LEGAL RIPHTS 

1 Contains this type of appeal 

Either way which ever women prefer, to do she has the right to do so 
They have a right just as men to go cut and work ^ 
Each human being has the right to dp what he or she wants to do 

2 Does not contain this type of appeal 

But if they should get equal rights, that means that the ones that do not 
support it/will have to suffer to 

I feel that if a woman wants to work that is her right, as long as she can 
take car0 of the children in the family 

Every woman should have just as much right to work as a man 

PURPOSE OF APPEALS 

1 Appeals advanced in own cause ^ 

2 Appeals to refute opposing position « 

3 Appeals both advancing and refuting 

4 No appeals given 
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Looking at a piece of student writing, we can make judgments about both 
the appropriateness and the maturity of word choice or diction. Appro- 
priateness is a matter of the particular relationship among writer, audi- 
ence, subject, and the purpose the writer is trying to achieve. Our judg- 
ment about, the approi)riateness of a writers diction depends almost" 
entirely upon our sense of this relationship. Judgments ^about maturity of 
diction are another matt€(r. We are no longer prima^ly concerned with 
the relationship among speaker, audience, subject, aiirf purpose. We are 
interested, rather, in the probability of a given word s appearing in the 
discourse of writers of different ages. In the following chapter, Patrick 
Finn shows how the computer can give us very precise characterizations 
of the maturity of word choices in a piece of writing by comparing the 
writer's choices to standard word frequency indexes. Finn conjectures 
about how students, teachers, and researchers might be able to use this 
kind of information about wrijting. 
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COMPUTER-AIDED DESCRIPTION 
OF MATURE WORD CHOICES 
IN WRITING 



Patrick /. Finn 



The Computer and Evaluation of Writing 

Two convictions frequently held by teachers of v^^riting regarding the use 
of the computer in evaluating writing have a devastating eflFect on com- 
munication. One conviction is that the computer can, and someday will, 
replace human evaluators and do a better job of. evaluating writing. Peo- 
ple holding this belief begin to read a discussion like the one presented 
below with high hopes that the day has arrived. When they see at some 
point that what is being suggested will not replace human raters.{thereby 
relieving them of an onerous task), they stop reading and are disappoint- 
ed. Such readers should be forewarned that this paper contains no pro- 
posal that will replace human evaluators of student writing. 

The second conviction is that writing is a product of intelligence and 
creativity and that a computer cannot evaluate this product. A corollary 
to^this conviction is that suggestions to evaluate writing by computer are 
symbolic 5f a basic struggle between engineers and humanists. Readers 
holding this conviction may be assured that this chapter does not propose 
that a computer evaluate themes. A computer cannot evaluate themes; it 
cannot even add numbers. Adding is an intelligent process. A person can 
wire a computer so that holes punched in cards (representing numbers) 
will close certain electrical circuits and cause a number to be printed 
which will be the same number a person would write if he or she were 
adding. But the computer is not adding. Circuits are simt)ly. opening and 
closing within the computer because a person designed the circuits to do 
so under specified conditions. 

In this chapter I wiil propo' 3 some ways of making judgments about 
word choices. These judgments are based on human observations about 
the nature of language in general and the nature of the writing of individ- 
uals; some deductions can be made from these observations. But first, a 
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" \ great deal of hunting of word frequencies is necessary. The computer, 
\ receiving and transforming electrical impulses, will print the same lists 
\and numbers as a person who is counting words, but the computer can 
produce the lists and numbers in a minute fraction of the time it would 
* rake a human to do so. Therefore, the computer is not making judgments 
. , or evaluating anything; it is simply a tool. 

Whm any suggestion is made (involving the use of the computer or not) 
regarding tihe improvement of teaching writing^ responding to writing, 
evaluating writmg, etc., someone is dissatisfied. If one person proposes a 
way of diagnos^g spelling difficulties, another says *Tes, but it doesn't 
improve paragraph structure." When a speaker proposes a way of enhan- 
cing student creativity, there is the inevitable "Yes, but it doesn't improve 
spelling." This chapter describes and responds to only one component of 
students' writing— word choices. 



Earlier Expbration into Using the Computer to Evaluate Writing 

In an article entided, **The Imminence of Grading Essays by Compu- 
ter," Ellis Page (1966) argued that some features of written language can 
be measured by computer, and he proposed that it is reasonable to deter- 
mine grades for students' essays on some of these variables. 

Page coined the words proxes (for "approximate variables") and trim 
(for "intrinsic variables"). For exarnple, there is an intrinsic .Ceatute^of 
writing which we may call "syntax complexity." One may ileason that 
penons who produce more complex syntax are apt to u$p more preposi- 
tions and subordinating conjunctions than persons who produce less com- 
plex syntax. A computer can be programmed to produce a list of preposi- 
tions and subordinating conjunctions found in writing. Here is a variable 
which is intrinsic in writing, and a second variable which one can pro- 
gram a computer to tabulate. Page proposes that such tabulations of the 
prox (the number of prepositions and conjunctions) reflect the true value 
of the trim (syntax complexity). 

Page (1968) demonstrated that grades arrived at by computer tabula- 
tion of some 30 proxes (e.g., sentence length, number of subordinating 
conjunctions, average word length in letters) correlated as well with the 
grades assigned by four human judges as the grades of the four human 
judges correlated with each other. Slotnick (1972) demonstrated that fac- 
tor analysis of 34 proxes accounts for six factors which he named Quality 
of Ideas, Spelling, Diction, Sentence Structure, Punctuation, and Para- 
graphing. 
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Slotnick and Knapp (1971) concede that grading by counting proxes 
does have limitations, but they point out possible applications of compu- 
ter tabulation which may be more important than assigning grades. For 
example, the correlation betweeiflabulations of proxes and grades given 
by human raters may give us v^aluable insight into the bases of judgment 
'^^::acpedenQed^say graders. One rater is cited who, upon discovering 
that^s glides corf^ated-morelii^y with proxes associated with vocab* 
ulary tfaan^dse proxes associated with syntax, claimed to have been sur* 
prised by this^'finding and said he gained a heightened awareness of his 
own processes in evaluating themes as a result. Secondly, computer tabu^ 
lation ndght be regarded as a source of data analogous to having asecond 
reader. Finally, computer tabulation might be put into a format which 
would suggest pois^ible problems in an essay directly to the student wri- 
ter. These suggestions might be used as a basis for rewriting before the 
theme is handed to the instructor for evaluation. 

These three suggestions--(l) heightening awareness of intrinsic vari- 
ables to which human evaluators may respond, (2) using the computer 
tabulations to check on evaluation as one would use a second reader, and 
(3) presenting tabulations to the student as suggestions for possible 
rewriting--are more relevant to this chapter than the notion of actually 
assigning grades based on computer tabulation. 

The following demonstration of how these suggestions may be imple- 
mented is based on a set of student themes which were written on a single- 
assigned topic. This demonstration is not meant to be definitive but illus- 
trative. What appears to be useful here might not be entirely appropriate 
with themes on a different topic. However, it wfll be 'argued that the 
techniques employed are valid and generally applicable^, even if th^ 
details might need adjusting as the topic of the written sample changes. 

The Sample 

A set of 101 essays written by students in the Rochester, New York area 
forms the basis for this discussion. The themes were collected as part of a 
project directed by Thomas R. Knapp and reported by him at the annual 
meetingfof the American Educational Research Association in 1972. The 
stimulus for the themes was as follows: 

Imagine that a large company near you'has been found to be 
seriously polluting a local driver. Some people have been talking 
about closing the company ^own until something can be done 
about the pollution. If the company is closed down, many people 
will [be out of work. Write your feelings about whether to shut 
dowp the company. Be sure to indicate tx;^^ you feel the way you 
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The theme^'Vere written by boys and girls in gradesr4, 8, and 11. Some 
statistics describing the sample follow. Note the distinction between the ' 
woxdiojkenSy the total number of words, and the word types, the number 
^ of diff^ent words. 

\ ' * . i4« 

^ \ Graded Grade 8 ' Grade H Themes 

--dumber of Themes 36 34 31 101 

Number of Tokens 2.818. ^ ^5,852 6,134, 14.794 

Number of Types 592. , 012 1,145 1,817. - 

Knapp (1972) warns that this is a "grab sample,** meaning that the sam- 
ple was not scientifically chosen to represent fourth, eighth, and eleventh 
graders. For his puiposes a representative sample was not necessary. He 
also states that there was attrition in the original sample particularly be- 
cause of the inability of some students to write on the assigned topic. 
Therefore, this sample probably represents the better fourth-grade stu- 
dents and the more cooperative eighth- and eleventh-grade students. 

These themes are satisfactory for the present discussion because this is 
not a report of an experiment; it is a discussion of some principles of Nyord 
frequency with suggestions for how these prirfciples might be employed 
in the analysis of students' word choices. A representative sample of 
themes would probably reveal more striking differences between grades 
and better demonstrate the feasibility of using these principles for evalua- 
tion. However, establishing norms for word choices is only suggested 
here and is not represented as an accomplished fact. 

Two themes from this sample, each followed by an alphabetical list of 
word types appearing in the theme, follow. In several respects Theme B is 
superior to Theme A, but for the purposes of this chapter, only the word 
choices will be considered. Theme B yields what appears to be a more^ 
mature list of word types than Theme A. But this is a subjective judgment. 
The task set forth in this project is to devise a way of making more precise 
and objective statements about comparative maturity of word choices as 
exemplified in Themes A and B. 

Theme A: Grade 4 

Types: 72 Tokens. 141 

I think they shouldn't because the people need jobs to support there family. 
That is why we have poor people is either because of there color or they didn't go 
to school. More and more people are moving they need jobs badly. Look at tlie 
people in Rochester that just hang around because they have no money because 
there Black. AH of the white people blame them for stealing the money that they 
need for there family or some of them steal it for dope or drinking money. The 
people are polluting in the nver and killing fish. Why can t they put it in something 
so that it didn't pollute the .water. Now we can't get clean fish and eat the fish 
because they have grease or something eke. We see fish floating on the lake be- 
cause they pollute in the water. 
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Theme B: Grade. 11 
.Types: 72 Tokens: 101 
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People have been protesting against the evils of industry since the 18 hundreds. 
I think that it is very unnatural, unsafe, and also unhuman to pollute any river with 
illsmelling dye or any other form of industrial waste. So feeling this strongly 
against pollution I would fonn a group, an antipollution group and get the support 
of some local critics and p*^t into action some means of closing down the com- ^ 
pany. If this does not wor.% th^en I think I would caiffor the government to help to 
correct the abuse. And would advocate a new sy.*!tein of purifying the water. 

a 

abuse 
action 
advocate 
against ' 
also 
an 
and 

antipollution 
any 

-beeri v 
call 
closing 
company 

correct I 

Mature Word Choices and Word Frequency 

If one panel of judges was asked to choose^ the words from Theme B 
that indicated maturity on the part^ of the writer, and the second panel 
was asked to choose the words from Theme B which were comparatively 
uncommon words in English, they would probably compose the same 
list. It would include the words abusCy advocfttey antwollutioriy critics, 
cvUs, iUsmellingy pollute, pollution, puriftjingrsupport, and unnatural. 
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Again, if one panel of judg^ was asked to choose Theme^ or B as the 
theme reflecting more maturity of word choice and a second panel was ^ 
asked to choose Theme A or B as the theme having more uncommon 
words, both panels would probably choose Theme B. 

Word frequency has been used as a measure of word "quality" for - 
n^any years; it has been used to estimate the amount of "work" accom- 
plished by a word (Zipf 1965), the amount of "information" delivered by 
a word (Chjerry 1957), and the degree of "importance" of a word in a text 
(Luhn 1959). Lotge (1944) reports that Talmudists used word frequency 
in text analysis over a thousand years ago. The analysis suggested in this 
paper is based on word frequency as well. 

Three large-scale word counts have been done in America by Thorn- 
dike and Lorge (1944), Kucera and Francis (1967), and Carroll, Davies, 
and Richnian (1971). The 1971 word frequency list is used in the study 
reported here. Cauroll, Davies, and Richman tabulated word frequencies 
in a corpus of over five and a half million words drawn from over a thou- 
sand textbooks used in American schools in 1969. The study reports not * 
only the actual number of times each word appeared, but also the distri- 
bution of the word by grade and school subject. Since the sample was 
drawn by a sophisticated statistical technique, the authors were able to 
estimate the probability of each word's occurrence in a theoretical sample 
of all textbooks. This estimate is reported as a Standard Frequency Index 
(SFI). If a word has an SFI 6f 90, one would expect to find it once in every 
ten words. (The word the lias an SFI of 88.6.) If a word has an SFI of 80, 
one would expect to find it once in every 100 words. (The word i$*has a 
standard frequency of 80.7.) The SFI in increments of ten, the probability 
of appearance in an indefinitely large sample, and an example wqrd ap- 
pear in Table 1. 

Words having low SFIs are not bizarre words. Using frequencies to 
identify mature word choices is not equivalent to looking for freakish ^ 
vocabulary or words whose meanings are known to a highly select group. 
When I refer to words as uncomMm, the qualification rilatively uiicom- 
mon is always intended. 

If the relationship between mature word choices and word frequency 
were uncomplicated, a person would merely have to find the word fre- 
quency for each word in a theme, ayeragelhis frequency (the sort of 
judgment- free tasks for which computers are useful), and compare 
themes for average word frequency. This would constitute an objective 
measure reflecting relative matiurity of word choice. Unfortunately, this 
relationship is complicated. Other factors a£Fect word frequency besides 
"difficulty" and other factors affect word choices besides "maturity." 
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When these"o£eir factors are recognized and acco>^ted for, however, the 
knowledge of frequencies becomes very useful in identifying maturity in 

' word choices. _ „ ; ^ \ 

The first source of complic^on is that students write rare words" for 
reasons other than matturity. One reason iji;1hat i^ost topics, dicfale the 
choice of certain words. If the assignmei^^palls f^ a discussion of the 
relationsbip between pollution and emplo^^iCynich is what our sam- 
ple calls for, it would not be surprising to find >^prds like company, facto- 

V ^> i^^^y poUution, HXj^'waste oh the papers jir the most immature stu- 
dents. It is difiScu}t to imagine a paper being %ifritt^ on this topic without 
some of these words, but these are not higb^ frequent >yords. Their SFI*s 
are as follows: company, 58.0; factory, 56.0i^jdbs, 56.1; poUution, 43.6; and 
. waste, 54.9. \ \ ' - 

s ^ The question then becomes, how does one identify words that are de- 
manded by the topic of the paper ind therefpre do not indicate maturity 
of word choice regardless of their SFI. Inf^rpiation scientists (Ldm 1950; 
Carroll and Roeloffs 1969) are askihg ^entially the same question when 

* they ask how word frequency information mi^t be used to md a list of 
words in a tdxt that ought to be included in an index. Luhn v^as the first to 
suggest a very simple solution. If a word is very rare in the language and it 
appears repeatedly in a book, it is probably essential to the book's topid 
and should appear on the index. Eor Sample, the word diesel (SFI«42.4) 
is expected to appear about once in 900,000 words. If diesel appears ten 

. times in a ten thousand word chapter, it is probably a very important 
word in the chapter and should appe^ on the book s index. Of course, 
tabulating a word^s^appearances^in a chkp{^ and finding its SFI on the list 
^^be-doneln seconds with the aid of a computer. Luhn called words 

J iBoitified in this manner "Key Words."! 

Exactly the same reasoning pan be applied to students' themes. If a 
word is quite infrequent in the language ahd appears repeatedly in a set of 
themes, die word is probably intimately rdated to the topic. For example, 
one would expect the word environmem (SFI=55.4) to appear once in 
about 50(^ words and poUution (SFI=4j3.6) to appear once in about 
700,000 words. In the 14,794 word tokens in the sample, environricnt ap- 
pears. 14 times and poUution appears 148 times. Obviously, the use of the 
word poUution is dictated by the topic andlthe use of the word environ- 
ment is strongly suggested by the topic. Ra^ther than use the term "Key 
Word," which has been used to nan>e sevarallconcepts over the years, the 
term *Toi)ic Imposed Words" will be used to name the class of words 
discovert in students' themes using the concept explained in this para- 
graph. ^ \ 
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Table 1 



• Interpretation of the Standard Frequency Index 



SFI 


* Probability of the Word^s Occurrence 


Example of a Word 




in a Theoretical Indefinitely Large Sample 


with Designated SFI 


w 


l in every 


10 words 


thp f88 7^* 


'80 


1 in every 


100 words 


b (80.7) 


70 


1 in every 
1 in every 


1,000 words 


go 




10,000 words 


cattle 




t in every 


100,000 words 


quit 


40 ^\ 


1 in every 


1.000,000 words 


fixes 


30 


1 \n every 


10,000,000 words 


adheres 


20 


1 in every 


100,000,000 words 


cleats ' 


10/ 


nJ^ in every 


1,000,000,000 words 


votive tl2.7) , 



•Where no word has tfis^ehignated SFI, the SFI of the closest word appears in paren- 



Table 2 

Topic Imposed Words 



Word Type 




Frequency in Sample 



company 

pollution 

factory 

polluting 

jobs 

shut • 

companies 

clean 

closing 

polluted 

rivers 

pollute 

unemployment 

factories 

seriously 

waste 

workers 

cause 

sewage 

killing 

lose 



58.0 
43.6 
56.0 
33.7 
56.1 
56.7 
54.5 
59.7 
52.5 
44.2 
58.7 
37.1 
43.0 
56.5 
52.0 
54.9 
58.6 
.59.4 
45.9 
51.5 
56.8 



191 

148 
98 
61 
51 
50 

. 29 
28 
26 
23 
17 
16 
16 
14 
14 
H 

•14 
12 
12 
10 
10 
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The Relationship between the Assigned Topic and Mature Word Choice 

Hojv rarely must a word appear (how low an SFI must it have) before 
it is **\ety rare ? How often must it appear in a book before it is thought 
to appear "repeatedly? In indexing, as in identifymg Topic Imposed 
Words^ the answer may vary. One advantage of using a compji^erjs that ^ 
vone can try out con4>inations of values untU the list of words appears to lit' 

. Ae conii^pt of Tcvpic Imposed Words. The list of Topic Imposed Words 
in Table 2 was derived by, finding Avords which have an SFI of less than 60 
and whicW appear at least ten times in the entire set of themes, v 

The list appears to have face validity. All the words seem to be sugg^t- 
ed by the topic and those having higher frequencies in the sample appear 
to be demanded by the topic. It would be possible to refine the analysis of 
Topic Imposed Words if it served one s purpose. For example, the words 
waste and seuxige appear in eighth- and eleventh-graders' themes, but not*^' 
at all in fourth-graders' themes. It might be useful for some purposes to 
identify .words which the topic suggests ^to older students but not to 
younger ones. However, to keep the present discussion manageable, the 
Topic Imp6sed Words in Table 2 wiU not be furrier analyzed. 

The basic premise of this discussion is that word frequency can be used 
to identify mature word choices. This simple relationship is not demon- 
strated by simply ave^raging word frequencies of mature and immature 
writers; there are complicating factors. One is that some rare words may 
be chosen by immature writers because the topic demajuk using thes^ 

. woW^/ JW^eyiASuch words are identified and sorted out, the relatioiiship 
between worajrequency and maturity of choice becomes clearer. 



Low Frequency Words that Do Not Indicate Maturity 

Classes of words that are ^e>in print, but do not reflect maturity or 
sophistication, are a second cdmplicating factor in the relationship be- 
tween word frequency and maturity of choice. These classes of words 
become apparent When rare words (SFI less than 50) are identified in the 
theines of fourth graders. Only fifty such words appear 6n fourth-grade 
theines. Eight of these words (16?) are proper nouns. It is probably the 
highly specific referent, a unique property of proper noun^, which makes 
these words rare. Slang words, such as dope, fakCy junk, tnessyy skinny, 
and stinksy make up a second class of rare words used by fourth grkders. 
These words are so highly ^formal that they are not apt to appear in 
print— particularly not in textbooks. Contractions, such as isn't, can't, and 
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wotddnX make up a third class of words having low SFIs but not reflect- 
ing maturity. The informality of contractions causes these to be rare in 
print but fairly frequent in students' writing. 

If we eliminate **Mature Word Choices" from Tables 3 and 4, that is, 
words with an SFI of less than 50 but which are not Topic Imposed 
Words, proper nouns, contractions, or slang, we would discover that elev- 
enth graders produced 241 Mature Word Choices and the fourth graders 
only 34. The words themselves, plus the fact that seven times as many 
such words are produced by eleventh graders as fourth graders, are of- 
fered as evidence that this category of words is aptly named. 



Table 3 

Words on Fourth Grade Themes 
Having SFFs of Less than 50 



bake 


donation 


junk 


Ontario 


smartly 


bud 


dope 


kills 


payed 


someplace 


Burmaii 


dump 


Leo 


pills 


stealing 


cleaner 


empties 


lima 


reverse 


stinks 


clubhouse 


expense 


Lisa 


Rochester 


sues 


complain 


fake 


manages 


ruining 


tractor 


complains 


Freddy 
Freddy's 


messy 


seaweed 


transfer 


complaining 


mit 


sediment 


volunteer 


crabs 


grease 


mow 


self 


wells 


destroying 


Janie 


nay 


skinny 


worrying 



Identifying Words that Do Not Discriininate between Grade Leyeb 

The words in Table 5 were identified by searching for word types that 
appear on themes from each of the grades in the sample, 4, 8, and 11. 
Many, of these words are function words. Those that are not function 
words are so common that their use in a theme does not suggest maturity 
on the part of the writer. -In earlier drafts of this chapter, these words 
were called Non-discriminators, indicating that their use did not discrimi- 
nate between mature and immature writers. However, it is probably true 
that the proportion of words in a theme that appear on this list will dis- 
criminate. Themes with larger proportions of these words will be written 
by less mature writers. Therefore, this class of words is called "Undistin- 
guished Word Choices." The list in Table 5 is offered as the best evidence 
that words appearing at all grade levels constitute a cohesive set and that 
this sgt is properly named. 
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Table 4 

Words on Eleventh Grade Themes 
Having SFFs of Less than 50 



abuse 


controversial 


accepting 


conected 


adequate 


conecting 


advances 


corrections 


advise 


crisis 


advocate 


critics 


.agencies 


damaging 


agrees 


deadline 


aiding 


dealt . 


algae^ . 


decline 


allotted 


deduct 


alright 


definitely 


alternatives 


dependence 


ample 


deceased 


analyze 


designing 


Andrews 


disastrous 


anticipate 


discharge 


antipollution 


disgusted 


arises 


disposal 


assignment 


disregard 


assure 


drain 


^assured 


drastic 


availability 


dye 


awhile 


earning 


backing 


Eastman 


Ballentine 


ecology 


basically 


egotist 


beaches 


eighty 


bug 


eliminating 


builds 


empluy 


burden 


employees 


butts 


employers 


cares 


employing 


Catherine 


endangered 


cheaper 


enforcing 


chicken out 


en talk 


Cindy 


environmental 


citywide 


estimation 


closes 


eventual 


coatless 


everything's 


commit 


evik 


compensating 


facilities 


complain 


fade 


complaining 


fails 


compliances 


failures 


conceivably 


financial 


concertos 


filter 


confessed 


filters 


consequences 


financ( 


consideration 


fined 


contribute 


forbid 


controlling 


funds 



gals 


minute 


Sandy's 


gee 


minutes 


Sarah's 


Genesee 


moamed 


selfish' 


genuine 


Mom 


severely 


gross 


multitude 


Sherwood 


guilty 


naked 


shutdown 


gutters 


neglect 


shutting 


halted 


nitty-gritty 


sights 


halting 


nonchalant 


signing 


hardship 
hazards 


nowadays 


smarter 


offending 


solving 


heiiven 


opposing 


specialists 


hinder 


ourself 


specifications 


hippy 


overaU 


springing 


holders 


ownings 


stake 


hon^eowners 


participated 


starve 


how's 


personally 


statesmen's 


hurting 


petition 


suds 


ideological 


philosopher 


suicide 


ignored 


pollutants ^ 


swaying 


ignorant 


pollutes 


talkers 


t ill'smfelling 


possibilities 


technicians 


illustrates 


potential 


temporarily 


imposed 


preservation 


temporary 


improvement 


preserve 


terribly 


incoming , 


pressurized 


thereby 


incomplete 


presumably 


there's 


inconvenient 


priority 


Thompson 


inflation 


profit 


throws 


inform 


proposals 


trash 


innocent 


prospects 


ultimatum 


inquire 


prosper 


undersigned 


instrumental 


protesting 


unemployed 


insurance 


punishing 


unfortunate 


investigating 


purifying 


unhuman 


irritated 


Rd. 


uninhabitable 


irritating 


reactions 


unnatural 


jeopardize 


relevant 


unorganized 


jobless 


realist 


unsafe 


justify 


recycled 


unusable 


K. . 1 


refuse 


versus 


Kay \ 


refuses , 


voters 


Kodak ; 


regulations 


wastes 


layed-off 


replacing 


waterway 


litter \ 


representative 


well-planned 


logical ( 


reputations 


wildlife 


long-range , 


researchers 


worsen 


Mariene \ 


resolves 


wrecks 


menace ' 


ripples 


wrongs 


merit 


ruins 


Xerox 


mess 


j rusty 


You've 


minded 


* salvage 
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Undistinguished Word Choices 



^ a 
able 
about 
again 
air 
all 
also 
and 

animals 
another 
I any 

' anything 
are 

around 

as 

ask 

asked 

at 

away 

bad 

be 

because 

been 

before 

being 

better 

big 

build 

business 

but 

buy 

by 

call 

called 

canie 

can 

children 

cleaning 

clear 

close 

closed 

come 

could 

couldn't 

day 

did 

didn't 

do 



doesn't 

doing 

done 

don't 

down 

drink 

dumping 

each 

earth 

either 

else 

enough 

even 

every 

everyone 

everything 

fair 

family 

feel 

few 

filter 

find 

firs* 

fish 

fishmg 

food 

for 

form 

from 

get 

getting 

give 

go 

going 
good 
got 
had 

happen 

happy 

hard 

have 

having 

he 

health 
help 
him 
his 

home 



house 


no 


how 


not 


I 


now 


:f 
11 


of 


I'm 


off 




y ' on 


in 


once 


into 


one hundred 


is f 




it 


or » 


its 


' other 


job 


our 


just 


out 


keep 


over 


kul 


own • 


know 


part 


lake 


pay 


lakes 




let 


person 




place 


little 


plants 


live 


problem 


living 


put 


long 


rather 


look 


reason 


lot 




make 


river 




run 


man 


running 


many 


said 


may 




maybe 


save 


me 


sav 


mean 




men 


should 


might 


since 


money 


so 


months 




more 


someone 


most 


something 


much 


soon 


must 


source 


my 


start 


near 


,stay 


need 


still 


never 


stop 


new 


support 


next 


swim 



take 

talking 

that 

that's 

than 

the 

their 

them^ 

then 

there 

they 

thing 

things 

think 

this 

time 

to 

too 

try 

until 

up ' 

us 

use 

very 

want 

was 

water 

way 

we 

well 

what 

when 

where 

who 

why 

will 

with 

without 

won't 

work 

worked 

working 

world 

would 

years 

you 

your 
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The task proposed at the beginning of this chapter was to describe an 
objective system that would enable one to compare the word choices 
used in Themes A and B. In the preceding section several classes of words 
were identified among all the word choices made by all the 101 students 
in the sample. All of these classes were identified empirically, except the 
classes Slang, Contractions, and Proper Nouns. I feel that these classes 
would be reliably identified by judges; if this system were to be applied, a 
panel of judges might be used to check the judgments of the experimen- 
ter, particularly for the class Slang. Once these classes haVe been identi- 
fied and lists created, one can classify words on , individual themes in sec- 
onds with the aid of a computer. The words in Themes A and B have been 
so classified. The analysis appears in Tables 6 and 7. Although A is longer, 
both themes used 72 different words. (Theme A repeated words more 
often, creating a longer theme. The relationship between the number of 
word types and the number of word tokens has been explored elsewhere 
as a method of recognising maturity in writing. See Fox 1972.) Student A 
uses more Undistinguished Word Choices, more Contractions, Proper 
Nouns, and Slang, and fewer Mature Word Choices. The two students use 
the same numbers of Topic Imposed Words and Unclassified Word 
Choices. * ^ 

Perhaps with a set of a thousand themes instead of one hundred, norms 
could be established for the proportion of Undistinguished Word 
Choices, Mature Word Choices, Topic Imposed Word Choices, etc. 
Possibly the norms could take into account grade level and length of 
theme. One might do the same sort of thing with ten different topics so 
that a student being evaluated could choose a topic and so that the same 
student could write on different topics on different days to get a more 
reliable measure of word choices. 

Furthermore, the rank ordering of papers and comparing of papers to 
norms on the dimension of word choices are useful for purposes other 
than simply assigning grades. A theme may have so many usage prob- 
lems, for example, that the evaluator is blinded to other components of 
the writing. The proposed analysis permits the evaluator to look at word 
choice in isolation and n|ay permit him or her to discover a strength in the 
theme or perhaps to coijsider strategies for improving word choices as a 
response to the writer. 

For example, the anal /sis of Theme A suggests that some specific atten- 
tion might be given to the maturity of word choices. Is the student aware 
that in expressing opinions in writing, a slightly less informal tone would 
be more convincing to most reaiders? Writing out cannot, did not, and 
should not would add to the form Uity of the paper. One might ask, "What 
word would a writer in The Wee dy Reader have used instead of dope?** 
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Table 6 

Word Types Sorted by Objectively Defined Categories 



Theme A: 


Grade 4 






Theme B: Grade 11 




Types: 72 


Tokens: * 


141 




Types: 


72 Tokens: 101 


Undistinguished Word Choices , 


«U 


is 


see 


a ■ 




if 


some 


ftnd 


u 


80 


also 




mto 




are 


just 


some 


an 




is 


that 


around 


lake 


something 


/and 




it 


the 


at 


look 


support 


any 




new 


then 


because 


money 


that 


been 




not 


think 


either 


more 


the 


call 




of 


this^ 


else 


need 


them 


does 




or 


to 


family 


no 


there 


down 




other 


very 


fish 


now 


they 


for 




people 


water 


for 


of 


think 


get 




put 


with 


get 


on 


to 


have 




river 


work 


go 


or 


water 


help 




since 


would 


have 


people 


we 


I 




so 




I 


put 


why 










in 


river 













Contractions, Proper Nouns, Slang 



4 

can't 




didn't 


(none) 


dope 




Rochester 




shouldn't 





. Topic Imposed Words 



clean 




closing 


jobs 




company 


killing 




pollute 


"pollute 




pollution 


' polluting 




waste 



Mature Word Choice« 



^ 

grease 


abuse 


iil*smeliing 


stealing 


advocate 


protesting 




antipollution 


purifying 




correct 


unhuman 




critics 


unnatural 




dye 


unsafe 




evils 
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Table ^^--Coniin\ud 



HiemeA: Grade 4 


Theme B: 


Grade U 


Unclassified Words 


^badly 


hang 




action 


industrial 


block 


' moving 




against 


industry 


blame 


poor 




feeling 


local 


color 


school 




form 


means 


drinkiog 


steal 




government 


stxongly 


.eat 


white 




group 


system 


floating 






hundreds 





Table 7 



Comparison of Word Categories 
Represented oh Themes A and B 





Theme A 


Theme B 


Category 


Number 
of Types 


Percentage 
of Types 


I^^umber 
of Type» 


. Percentage 
of Types 


Undistinguished 
Word 'Choices 


47 


65 


41 


57 


Contractions, 
Proper Nouns» 
Slang 


5 


7 


0 


0 


Topic Imposed 
Words 


5 


7 


5 


7 


Mature Word 
Choices 


2 


3 


13 


18 


Unclassified 
Words Choices 


13 


.... i8 


13 


18 


Total Words 


72 


100 


72 


10^ 



/ 
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^ A very common failing in student ^iting is a lack of relatedness or 
consecutiveness of ideas— the qualky )f writing that rhetoric manuals re- 
fer to as **coherence." Lack of coji^ence springs from the writer's failure 
to see that the reader has a differfent mind from the writer s and, therefore, 
the connections between the writer s ideas must be made explicit. It is 
very difficult to, get a writer who suffers from this difficulty to understand 
what the trouble is. 
A teacher might d>^uss this very difficult concept of coherence with a 
) student by testing/ms Unclassified Words against the question, '^How is 
/ this word, as u^ in the theme, relevant to the stated purpose of the 
wheme (in thetase under discussion, the assigned topic of the theme)?" 
^he student^ who wrote Theme A might be asked how the words cotor, 
^ black, whitCy drinkingy moving, school and steal are relevant to the topic. 
, He might be made to see that the connections among race, schooling, 
employment, and factory closing are not made explicit in this paper. The 
stydent might either be able to develop the logic of l}is argument, or he 
^ay see that he has responded to a question about economics with a stere- 
/ otyped generalization and has failed to analyze the real question. 

This writ r could be helped to build on a very weak paper, By eliminat- 
ing contractions and slang and by making explicit the socio-economic 
• relationships he only hints at in the paper, he could develop a superior 
paper. ^ 

Theme B, on the other hand, is a coherent theme. One is struck by the 
appropriateness of this writer's Mature Word Choices and Unclassified 
Words. However, a person experienced with the technique and with the 
topic might notice something missing from these word categories. Earn- 
ingy empht/y etnployeesy financiaU fundSy hardshipsy income, inflatioriy 
joblesSy layed'Cffy stawingy and unemployed are examples! of Mature 
Word Choices used by Oiher writers on this topic. The presence of these 
words indicates that some writers have considered the plight of those who 
will lose their jobs if the factory closes. The absence of these ^vords from 
Theme B calls attention to a fact that might have otherwise gone unno- 
ticed: This writer has not considered the problem of the unemployed and 
has, therefore, ignored half of the assignment. 

Another fact revealed by considering word choices in isolation is that 
Thema A uses words referring to people 17 times {famityy twice; peopk, 
six times; f/iem, twice; and theyy seven times). Theme B uses the word 
people once, which, along with the other references to people (group, 
critics, and govemment)y is an impersonal, abstract reference. It is beside 
the point whether Theme A or Theme B is superior because of the kinds 
of words used to refer to people. The point is that the analysis proposed 
here makes such observations more probable and gives the evaluator av^ 
nues of response to students' writing that are not otherwise apparent. 
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Creatiiig a Topic Specific Dala^Base 

I have shown that words relating to unemployment and words relating 
to people can be identified on an ad hoc basis by using the objective word 
analysis to respond to themesjof individuals. It is possible to make such 
observations a standard part of the word choice analysis once we have 
observed that the presence or absence of certain categories of words 
might direct the attention of the writer or the teacher in useful, ways. 

The sdudysis of the themes might be done as follows: 1) The themes are y 
typed onto IBM cards. 2) A computer is progranuned to proce^ all thp 
themes and print an alphabetical list of all the types used, followed by^e 
Standard Frequency Index (taken from ihe American Heritage Wor^^re- 
quencu Book list on computer magnetic tape), the frequency of die word 
type on all themes, and the frequency of the word type in grades'4, 8, and 
11. (See Table 8.) By simple arithmetic, lists can be compiled of Topic 
Imposed Words, Matiure Word Choices, and Undistinguished Word 
Choices; by a quick scanning of the list, a judge can identify contractions, 
proper nounsi and slang terms. 

But scanning theialphabetical list of types, particularly after the Topic 
Imposed Words and Undistinguished Word^Choices are eliminated, one 
is struck by |the fact that the^e are other clarifications of words which 
seem, to reflect maturity, but which require intelligent and subjective 
judgment. For example, in the presertt sample, the following categories of 
words appear to reflect maturity of word choice on the part of the writer: 
Abstract nouns (e.g.> aUematives, efforts, evUs, menace, reasons, suicide); 
verbs that indicate cognitive activity rather than physical activity (e.g., 
abuse, blame, complain, investigating, tnanage, support); adjectives 
which reveal a judgment on the part of the writer regarding an abstract 
"state (e.g., adequate, controversial, drastici genuine, potential, unnatural). 

If judges were to scan the alphabetical list of types produced in a hun- 
dred themes and identify Abstract Nouns, Verbs Denoting Cognitive Ac- 
tivity and Adjectives Judging an Abstract State, the words that were relia- 
bly classified could 'make up semr-objective lists which would define 
useful categories for describing word choices. A data base could then be 
created to identify each of the approximately 1800 words produced in 
these iOO themes as in Table 8. 

A data base of this sort could be used to describe word choices of stu- 
dents who are not included in the sample but who are asked to write ar- 
theme on the same topic. If Theme B had been written after the data base 
had been compiled, the analysis would have revealed that this theme has 
five abstract nouns {action, government, means, support, system) and 
four verbs denoting cognitive activity {correct, form, h^lp, think). How- 
ever, the words evils, abuse, advocate, feeling, unhuman, unnatural, and 
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unsafe would not be in the data base since they do xLt appear in the sam- 
ple outside of Theme B. The computer could be.programmed to find the 
SFI for these "Unique Words" and print them out with a few words of 

.^context from the theme so that they could be classified by the analyst.. 
These new classifications could be added to the analysis in Table 6. 

Sets o(^themes on specified topics might be sent by a teacher to the data 
processing office of the school district. The theme? would be typed onto 
c^ds and submitted to the computer which would be programmed to 
count words in a theme, match words to appropriate lists in the data base, 
find the SFI of the words it does not find in the data base and print the 
word^ types in each theme in appropriate lists, and finally print a list of 
wprds that are in the theme but not in the data base, with the SFI and the 
context in which the word occurs in the theme. An analyst would then 
classify the new words, type them into a terminal, and obtain anew anal- 

*ysis. 



Table 8 

Data Base for First Twenty-Five Word Types in Sample 







Frequency 


Objective 
Categories 


Semi-Objective 
Categories 


Word Type 


.SFI 


All 


Gr4 


Gr8 


Grll 



a 

able 
about 
absolutely 
abuse 
accept 
accepting 
achieved 
act 
action 
actions 
actually 
addition 
adequate 
advances 
advise 

^advocate 
affected 
anecting 
4Uford 
after 
afternoon 
— agai n 

^.against 
age 



.5 
A 
A 
.2 
.4 



83.9 
63.7 
73.8 
50.7 
40.0 
54. 
45. 
51. 
59. 
- 59. 
53.1 
59.3 
60.2 
46.6 
. 48.9 
46.7 
^^0.6 
.52. 
44. 
51.9 
70.6 
59.6, 

fiSS 

65.1 
60.7 



.4 
.6 



308 
21 
62 
1 
1 
1 
1 
3 



6 
2 
2 
1 
2 
1 
2 
1 

2 
1 
3 

13 
2 

10 
4 
2 



40 
4 
8 
0 
0 
0 
0 
0 

0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
2 
0 
0 

1 

0 
0 



135 
8 

33 
0 
0 
0 
0 
0 
0 
3 
0 
0 
0 
0 
0 

1 

0 
0 

i 

0 
7 

1 

7 

1 

2 



133 
9 

21 
1 
1 
1 

U 

3 

1 

3 

2 

2 

1 

2 

I 

1 

1 

2 

0 

1 

6 

1 

2 

3 

0 



Undbt. 
Undbt. 
Undbt. 

Mature 

Mature 



Mature 
Mature 
Matut^ 
Mature 

Mature 



Undbt. 



Abstract Adj. 



Cognitive Verb 
Cognitive Verb 
Cognitive Verb 
Cognitive Verb 

Abstract Noun 
Abstract Noun 

Abetract Noun 
Abstract Adj. 

Cognitive Verb 
Cognitive Verb 



Cognitive Verb> 
Abstract Noun 

Abstract Noun 
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' yin high schools and colleges s^ad^ts might have access to computer 
terminak or iceypunch machines and type their own themes into compu- 
ter readable lorm on a fairly regular basis, assuming there was a data base 
for a variety, of writing assignments.The computoT could be progranuned 
to write out messages showing discrepancies between the student's theme , 
and norms developed for that grade level. The student might use the sug- 
. gestidns for revisions. 

For example, the computer might be progranmaed to receive themes 

. and to print out qu^tions like the following under specified conditions: 
** • 

-rHave you considered the problem of unemployment in writing your 
.theme? ; . 

— Woi)ki your argument be more convincing if you used cannot instead 
of c<w>V? 

—Is the word poUote spelled correctly? 

—You use the word uxfrkfrt seven times. Could you combine some of 

the ideas about workers into the same sentences? • 
—You hive used the word the^ eleven times. Is the reference always 

de^ ' ^ ^ . 

For themes written to fulfill diflFerent assignments, the computer might 
be programmed to write the following questions under specified condi- 
tions: 

"—Have you told what the boy in the picture is thinking? ^ 
—Have you described the setting for this story? 
—Can you make the relationship between your ideas clearer by using 
such w,ords as aUhought Aou>^er, but, or therefore? 

If the analysii is to be used by the teacher rather than^yen directly to 
. the student, the message might reflect the basis of observation as well as 
the suspected problem. For example: ^ - 

s 

—An extraordinarily high proportion of Mature Word Choices. Check 
^ for slang and/or a tendency to .overwork vocabulary at the expense 
of clarity or simplicity. 

—Very tew Topic Imposed Words. Has the student written on the as- 
signed topic? / ' . 

—Extraordinarily high proportion of pronouns. Is reference always 
clear? Mights sentence combining be in order? 

—Few Cognitive Verbs. Many action verbs. Has the student disci!is»ed 
Ae motivation cf the characters? 

The kind of data base suggested for the topic discussed in this chapter 
could be developed for any number of topics. Word categories used in 
the data base would vary from theme to theme. One can imagine ajtheme 
topic where adjectives denoting duration (e.g., constant, extended, fre- 
quent, lingering, prolonged, repeated, sustained) or mental states {cheer- 
iul, furious, gloomy, happy, sober, u?eart/ )"wmrtd constitutrnsrctes of 
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/ 

words identifying mature themes. With some topics the categories based 
on word frequencies might be highly discriminating between mature and 
j immature writers, while with other topics these categories may not be 
^ very discriminating. With some topics the semi-objective categories veri- 
fied by a panel of judges may be easily identified and highly useful in 
suggesting ways to improve themes; with other topics such categories 
might not be obvious or highly useful. 

The techniques outlined here should be tried with many, many topics, 
and those topics which lend themselves best to these techniques should be 
used to generate data banks (using 1000 themes rather than 100, perhaps). 
This-may-hdp-a-classroom teacher^^Jaog uage arts diagnosticia n, a re- 
searcher in language development, or a school evaluating institutBnliKe" 
the National Assessment to isolate, analyze, and organize one component 
of v/riting, word choices^ in order to respond to that component more 
consciously, more intelligently, and with heightened sensitivity. 
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Recent research in syntax has given us a precise, comprehensive descrip- 
tion of the development of syntactic ability through the school years and 
^of the possihilities of syntactic fluency in the writing of publishing profes- , 
sionals. The two names nriost often associated with thiS research are Fran- 
cis Christensen and Kellogg Hunt.. Within the classroom, teachers are 
learning to use this research, along with other insights from trans- 
formational-generative grammar, for fonnative evaluation, demonstrat- 
ing to student writers the possibilities in their writing for various 
embeddings.conjoiiiiings, substitutings, and loose, additive modifications. 
Teachers are also beginning to use special materials which provide 
intensive sentence-combining practice for students, practice which 
produces maiketJ increases in their syntactic fluency. 

In this chapter Kellogg Hunt reports recent research which confirms 
findings from his initial research of the 1960s. His new fihdihgswill^eas- 
sur^ teachers and researchers of the usefulness of key syntactic structures 
for 'describing writing performance and measuring growth in writing. 
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EARLY /BLOOMING 
AND LATE BLOOMING 
SYNTACTIC STRUCTURES 



/ Kellogg W. Hunt 



For a dozen years now I have been interested in describing the syntactic 
stnictiire of the sentences produced by schoolchildren as they pass from 
the early grades to maturity. .The children and their sentences obviously 
do mature, ana^.the more we know about the process, the more we can 
hope to help them^in their writing, and perhaps also in their speaking and 
reading and thinking. If the description of such a process is comprehen- 
sive enough, that description becomes a scientific theory, a model. It can 
then be tested in unanticipated ways, and thus be either confirmed or 
disconfirmed/b^ the data obtained with the new procedtfre. In this Chap- 
ter I will present certain new data that bear upon 'an earlier theory, con-.^ 
firming it at pertain points and refining it at still other points. 
' My. first studies (Hunt,1964, 1965, 1967), like other studies of the sixties 
and before, forked on a large body of writing, one thousand words from 
each student. For a fourth grader to write a thousand words sometimes 
took a whole school year. This writing was on whatever topic the children 
happened to be concerned with in the normal course of their schoolwork. 
The writing was free of any control from me, the investigator, including 
subject matter and style. I will referto such writing hereafter asfree writ- 
ing. ./ 

Since^ completing those two studies in the 1960s, I have conducted two 
other s^tudies (Hunt 1970, and 1974 unpublished) using a carefully con- 
trolled method for eliciting writing from students of different ages. I call 
this kind of writing rewritingy m contrast to free writing. Obviously it is a 
special kind of what we ordinarily think of as rewriting. A student is given 
a passage written in extremely short sentences and is asked to rewrite it in 

//* 91 . ^ 
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a better way. Once this is accomplished, the researcher can study what 
changes are made by students at different ^ade levels. 

There are several advantages ^o this procedure. For one thing, since all 
students rewrite the same passage, all students end up saying^thasame^ 
thing— or almost the same thing. What differs is how they say iti" Their 
outputs are strictly comparable. The differences are, unmistakable, so a 
smaller corpus of writings can be used. A second advantage of the re- 
writing technique is that students can be confronted with specific syntac- 
tic problenis which the investigator wants them to handle. To discover 
their method of handling an unusual problem in their free writing, the 
investigator might have to wade tediously through a vast corpus. A tfiird 
advantage is that a student's syntactic, maturity can be tested with a re- 
writing instrument in less than a class period, but to get a representative 
sample of a fourth graders free writing would take many hours. 

T^ere is, of course, a danger in generalizing from a single rewriting 
instrument. The results obtained will depend to some extent on the prob- 
lems sef)linof ar as the investigator sets an abnormal task he or she will g^t 
' an abnormal result. These results need to be checked againstf ree'writin^._ 
For instance, in one of the rewriting studies^ not one of the 250 students 
participating, some of them twelfth graders of superior IQ, produced a 
single noun clause. But in another rewriting study, covering comparable 
ag^ groups, noun clauses were produced with an average frequency of 
about one per student. There is nothing mysterious here. The differencfe in 
the outputs was determined by the difference in inputs. One instrument 
provided abundant opportunity for the production of noun clauses: the 
other provided none. We predicted that difference when we designed the 
two instruments. ' / _ / 

In order to review two of the claims I made in the sixties about syntac- 
tic maturation, I must first nitroduce the term *T-unit."The easiest way to 
explain what I mean by this term is to use examples. My favorite exiample 
is the following passage written by a fourth grader. As you will see, this 
fourth grader wrote intelligibly enough— even forcefully— but he didn't 
punctuate at all. He wrote all this as a single sentence. j 

I like the movie we saw about Moby Dick the white whale the 
captain said if you can kill the white whale Moby Dick I will give 
this gold to the one that can do it and it is worth sixteen dollars they 
tried and tried but while they were trying they killed a whaleiand 
psed the oil for the lamps they almost caught the white whale. 

Now let "me cut this passage into its T-units. I will define a T-unit as a 
single main clause' (or independent clause, if you prefer) plus whatever , 

' • / 

*A clause Is defined here as a subject (or coordinated subjects) with a finite verb (o^ 
coordinated finite verbs). j f 

lOi ' 
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*' . ^ • ' / ' • / 

other subordinate clauses or nonclauses are attached to, or embedded ^ 

within, that one main clause. Put more briefly, a T-iinit is a single main // 

clause plus whatever else goes with it. Here is the passage reprinted, with / 

each T-unit numbered and beginning a new line, j / , 

' f 

1 I like the movie we saw about Moby Dick the white whale 
t 2 the captain said if you can kill the white whale Moby Dick I wilj;feive 

' this gold to the one that can do it ' 

3 and it is worth sixteen dollars 

4 they tried and tried . ' w 

5 - but while they were trying they killed a whale and used the oil for tlje 
, lamps / ■ 

6 they almost caught the white whale. j j 

As you read those T-units^ you may have nohced that each one ij a 
grammatically complete sentence, regardless of the fact that one bemns 
with and and another with but. (Of course they are grammatically com- 
plete; each contains a main clause*) You may also have noticed t^at tney 
are the shortest stretches of wordage that the passage can be cut into with- 
out creating some fragment, (Of course they c^annot be reduced further; 
each, contains only one main clause.) For example, if we cut the fi^st of 
these into two pfec^one of the pieces would be a fragment. 

I like the movie (grammatically a sentence) / 
we saw about Moby Dick, the white whale (grammat- 
ically a fragment) j ' 

Perhaps it would be safe for us to think of/T-units as the shortes^ gram- 
matically complete sentences that a passage can be cut into withbijt creat- 
ing fragments— but it is safe to do so only sc long as we rememjper that 
two main clauses must be counted as two T-units. The T in T-unit stands 
for "terminable." Giammatically, a T-unit 6an be terminated wit^ a peri- 
od or other terminal nriark. 

The reason for definin a T-unit, as distinguished from^a seiltence,' is 
simply that the T-^nit turns out, empirically, to be a useful concept in 
describing some oFthia changes that occur in the syntax oi the/sentences 
produced by schoolchildren as they grow older. When we knAw what a 
T-unit is, we can understand certain measures of inaturiH^ thajc we could 
not understand without it. / / 

On the basis of niy studies of free \yriting in the sixties, ^made two 
broad claims. One was that as schoolchildren get older, the T-units they 
write tend to get longer, measuring length as the mean number of words 
per T-unit. This claim might be called the T-unit length hypothesis. To 
get the mean T-unit length of the pa!j(sa^e already analyzed, one simply 
counts the total number of words (in th1^case68) and divides it by the 
. number of T-unit.*?' (in this case 6, giving a score of 11.3) . Th^ score for any 
. other passage wo^iild be arrived at in the same way.| 
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. The T-iinit length hypothesis is easy enough to prove true or false. All 
one has to do is get a representative sanipl^^Crpr^ a school population of 
one age and another from a comparable pQ^iilation of another age and 
compute the scores for the two samples. If the score for the older group is 
larger, then that evidence tends to con^m the claim; if not, then that 
evidence,tends to disconfirm the claiia. So many researchers have found 
that their evidence tended to confirm the claim, that I suppose it is now 
accepted by all persons who know about such matters.^ 

A second broad claim which came from my study of free vmting in the 
sixties is that as schoolchildren gee older they tend to consolidate into their 
T-units a larger aiid larger number of what transf ormajtional grammarians 
call S-constitucnts. An S-constituent is something abstract, not something 
concretely and tangibly observable like a word. Roughly speaking^^S- 
constituent is the abstract structure that underlies the simpl^^qf ^ 
sentences— what used to be called kernel sentences. ' Several 
constituents may underlie a single sentence of ordinary cpmplexity. For, " 
instance, in Aspects of the Theory of Syntax (1965), Chomsky indicat^ 
that three S -constituents underlie the sentence "The man who persuaded 
John to be examined by a specialist was fired." One S-constituent would 
be the abstract structure underlying "Someone fired the man." A secojnd 
would underlie "The man persuaded John." A third would underlie "A 
specialist examined John." My claim was that as schoolchildren grow old- 
er, they consolidate a larger and larger number of such S-constituents into 
their actual T-units. We might call this the "number of consolidations" 
hypothesis. 

since .S-constituents are abstract and theoretical,^ it is nol possible to , 
prove or disprove this hypothesis easily and directly like the other one. 
Nonetheless, it is an interesting experiment to study how schoolchildren 
consolidate, not abstract S-constituents which underlie extremely simple 
sentences, but extremely simple sentences themselves. 

That is what a rewriting instrument can show. And now we will look, in 
some detail, at the changes made by schoolchildren on the first six sen- 
tences of the "Aluminum" passage. Here are those six.^ 

1 Aluminum is a metal. 

2 It is abundant. 

3 It has many uses. ^ ^ 



^Various extensions and refinements to the claim have been made. One of the first (Hunt 
1967) was that T-unit length tends to vary with mental age, not just chronological age. 
Another (O'Donnell, Griffin, and Norris 1967) was that T-unit length in speech as well as 
writing tends to increase with age. Another (Pope 1974) is that T«unit length for fourth grad- 
ers varies somewhat with the mode of discourse. 

n*he "Aluminum" passage can be found in its entirety at the end of this chapter. 
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4 It CO bauxite. *' 

5 B^idute is an ore. 
^^^.J^Dsmite looks Iflce clay. 

.^How would studaits of- jliffi?i:ent grade levels rewrite this passage? 
A typrcal output of a fourth grader is printed in the right-hand column 
below, the input is reprinted in the left-hand column. 



1 ^Aluminum is a metal. 

2 It is abundant. . 

3 It has many uses. 

4 ^ It comes from bauxite. 

5 \ Bauxite is an ore. 

6 Bauxite looks like clay. 



Aluminum is a metal and 
it is abundant. It has 

-manynses-and^it-comes 
from bauxite. Bauxite is 

"^an ore and looks like clay. 



What syntactic changes has the fourth grader made? In the last T-unit he 
has dfeleted the subject, coordinating the two predicates. In addition he 
has put and's between two pairs, of T-units. In summary, then, he has 
coordinated two pairs of T -units and one pair of predicates. That is all. 
How would a typical student rewrite these same six input sentences 
ears later, that is, as a typical eighth grader? His output is printed in 
e right-hand column below. 




Aluminum is a metal. 
It is abundant. 
It has many uses. 
It comes from bauxite. 
Bauxite is an ore 
Bauxite looks like clay. 



Aluminum is an abundant 
metal, has many tises, and 
comes from bauxite. 
Bauxite is an ore that 
looks like cla^. 



The eighth grader takes the predicate adjective of the second input and 
makes it a prenominal adjective, abundant metal, lie coordinates three 
'predicates, inputs 1, 3, and 4. He transforms input 6 into a relative or 
adjective clause. He does not coordinate any full T-units. 

To avoid tedium, I will not show how a typical tenth grader or even 
twelfth grader would rewrite this. Instead, see how a typical skilled adult, 
someone whose articles appeared in Harpers and Atlantic, would rewrite 
it. . 



1 Aluniinum is a metal. 
2. It is abundant. 

3 it has many iises. 

4 It comes from bauxite. 

5 Bauxite is an ore. 

6 ' Bauxite looks like clay. 



Aluminum, an abundant 
metal with many, uses 
comes from bauxite, a 
clay-like ore. 



This typical skilled adult transforms the predicate adjective of input 2 into 
a prenominal adjective, abundant metal, as did the eighth grader. He re- 
duces input 1 to an appositive. Aluminum, an abundant metal He 
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changes the verb has from input 3 to the preposition wUh. He chanjges the 
predicate looks like clay into the modifier clay-Uke. He transforms input 5 
into a second appositive, bauxiteyja clay-like ore. 

Looking back at these three sample rewritings, let us see whether they . 
tend to confirm or disconfirm the jtwo claims made earlier. You m ill recall 
that one of the claims made on the basis of free writing was that the num* 
ber of words per T-unit increased with the age of the writer, at least 
through twelfth grade, and the number was still greater for skilled adults. 
Even in our tiny sample of three rewritiogs we can see this tendency man* 
ifest^ Our fourth grader ^prpduced twenty-five words in his five T-units, 
for &n average of five words per T-unit.xThe eighth grader produced 
twenty words in two T-units, for an average of ten words per T-unit. The 
skilled^'adult produced thirteen words in one T-unit. So our inaease has 
been from five to ten to thirteen. 

This increase is not far off the means in the full experiment, where fifty 
students out of several hundred from each grade were chosen so that their 
scores on standardized tests would represent a ^omial distribution of 
. scores from high to low. The grades chosen wer^4, 6, 8. 10, 12, a total of 
250 schoolchildren. In addition, out of a number, of authorc who recently 
had published articles in Harpers or Atlantic Jtweaty-Gve rSwrote the 
passage. They are here called skilled adults. Furthermore, twenty-five of 
-Tallahassee s firemen who had graduated f ro^ high school but had not 
attended college rewrote the passage too. They will be called average 
adults. - ,^ 7 

For this larger population of 300 writers in the "Alumimmi" study, the 
words per T-unit mciceased at every two-y^ interval, the difference be- 
ing significant at the^ .61 level, ftere are the? figures for G4, G6, G8, GIO, 
G12, average adults, and skilled adults: 5.4f, 6.8, 9.8, 10.4, 11.3, 11.9, 14.8. 
Notice that average adults are only a little above twelfth graders, but 
skilled adults are far above both groups; 

So there is no doubt that the rewriting study tends to confirm the claim 
about T-unit length. How about the other claim— the one about the num- 
ber^f S-constituents or simple input sentences? Our fourth grader consol- 
idated the six input sentences into,five inain clauses, five T-units. Put the 
other way around, we ct)uld say^that his five T-units are derived from six , 
input sentences, six S-consJituepts. The average for his five T-units, then, 
is six divided hy^v^,'6fone and one-fifth (1.2) input sentences per output 
T-unit. The eighth grader t:onsolidated the same six input sentences into a 
mere two T-units, so we could saythat the average for him is six divided 
by two, or three input sentences per output T-unit. Where the fourth 
grade score is about one, theeighth grade score is about Qiree. The skilled 
adult consolidated all six inputs into one output T-unit. So we would score 
him six input sentences per output T-unit. 
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To review, then, the fourth grader's score is about one; the ei^th grad- 
er's score is three; tfi^ skilled adult's score is six. These scores increase with ^ 
age;so the samples, which are fairly typical of fixe rewritings from a large 
number of carefully selected subjects in the full experiment, provide data 
that tend to confirm one claim of the theory. > " 

For these 300 writers, a tabulation of their 10,000 .input^^ut struc- 
tures indicated that the number of input sentences per output increases at 
every age level, just as the theory woiild predict. Here are the scores for 
G4, G6, G8, GIG, G12, and skilled adults: 1.1, 1.6^:4, 2.8, 3.2, 5.1. Notice 
that skilled adults qre almost as far above twelfth graders as twelf & grad- 
ers are above fourth graders. y \ 

When sbidying free writing, a researcher sees only the output. Tpe in- 
put lies hidden m the writer s headyl^ presence is conjectural and can 
only be inferred. But in rewriting^^dne sees both input and output equally 
well. Neither is conjectural. St^e results of the rewriting instrument are 
critical to the theory, and, a^ wp see, they support both of the claimj,-^ 

So far in this chapter I jiave supported the claim that successivdy older 
students can corisolidaj^ a successively larger number of simplesentences 
into a^single T-unit.^sually when writers consolidate, Ae^mploy some 
sentence-combiiunj? transformation. They reduce ope of ihe sentences to 
. ^ometJiing less^an a sentence, perhaps to aphrase or a single word. Now 
we will lool^^iit certain of these syntactic changes to see which ones are 
Vised conmlonly even by the youngest^jyriters, which are used conmionly 
only bj^rniddle grad^ writers, and^^vHich are used commonly only by the 
oldes^Avriters. Thus we can sepdirate the early blooming syntactic struc- 
tures from the later bloonjing and even the latest blooming structures. 
/4t the outset we noticed that our fourth grader joined two pairs of his 
/^-units with flndj^ke did so with grainmatical correctness. He put his 
and s in the rigl>t*place, at the boundaries between tfie T-imits. He knows " 
where those^l^oundaries come. But hereafter he will learn to do this less 
often. Voting, children do it correcdy but profusely. Oldar writers do it 
corre<jtfy but parsimoniously. In the "Aluminum"* passage a typical fourth 
graider coordinates 20 pairs of T-units; a typical sixth grader about half as 
many, 9; a typical eighth grader, 6; a tenth grader about3;a^aDBif th^y 
er maybe 2; and a skilled adultl3,2i6r^ we see that 

T-unit.coordioatioivbloomsrearl^^ starts to die, but lingers on 

yeaSTbeing gradually smothered by its relatives. 
Coordination between predicates blodms early too, but it fades very 
little thereafter. Our fourth grader coordinated two of them, our sixth 
grader coordinated three, but our skilled adult knew too many better 
things to do. Typically, the number of coordinated predicates increases a 
little from. 04 to 06 and then drops off slightly. For the large sample the 
actual frequency is 1.9, 2.2, 2.2, 2.0, 2.0; for average adults 1.9; for skilled 
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adults L6* The number of opportunities to coordinate predicates is 26, but 
no one took more than about a tenth of. these opportunities. 

Can we say anything more about growth in coordination with and? 
Perhaps a little. Cpnsider what we might expect to be a slightly more 
difficult problem. Here are two adjoiniifg input sentences: 

^ 'S3 It contains aluminum. 
/ 24 It contains oxygen. 

Here both subjects are the s^e, so we might delete one of then! and get^ 
. coordinated predicate: 

It contains aluminum and contains oxygen. 

But both verbs are the same too, so we might delete both a subject and 
verb and get coordinated obj^ts: 

It contains aluminum and, oxygen. 

This is the more mature construction. 

Almost all of the writers in grade six and older used this more mature 
constniction, deleting both the subject and verb. But among the youngest 
group, the fourth graders, ahnost half deleted nothing at all, and of the 
remPtinin^ half more chose the less'mature construction. So even within 
coordination using. And, there are grades of maturity: least mature is to 
delete nothing; more mature is to delete the subject; most mature is to 
delete both subject and verb. 

Another fairly early bloomer grows out of inputs like onewuiiourr' 



1 Aluminum is a metal. 
4 It comes from bauxite.^ 

Our skilled adult^nSoIi3ated these two by deleting fe from the first sen- 
tence^nfflnaking it an appositive: 

Aluminum, n metal, comes from bauxite. 

He also made an appositive out of another pair. 

4 It comes from bauxite. 

5 Bauxite is an ore. 

This became 

. . . comes from bauxite, an ore. . 

The "Aluminum" passage provided two more pairs of sentences that in- 
vited appositive^ to be formed. Ability to .write appositives was in full 
bloom by grade eight, but not by six or four. Here is the number of appos- 
itives produced by successively older grades: 1, 8, 36, 30, 34. 

But not al! transformations are in full bl6om as early as coordination 
and the appositive. For instancv?, look at these two inputs: 
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1 Aluminum is a metal. 

2 It is abundant. 

Our eighth grader moved the adjective al7timion/ out of its predicate posi- 
tion in the second sentence and put it in front of the noun metal in the first 
sentence. 

Aluminum is an abundant metal. . 

Thus two T-units become one larger T-unit. 

The ** Aluminum" passage provided six pairs of sentences like this, invit- 
ing a predicate adjective to become a prenominal adjective in some ad- 
joining input sentence. The fourth graders performed this transformation 
13 times, sixth graders 66 times, eighth graders 140 times, tenth graders 
212 times, and twelfth graders 223 times. Here we have the strongestkind 
of evidence of a steady increase in transformational facility. This transfor- 
mation blooms more and more profusely witK age. 

Our skilled adult did something elsp that the younger v/riters did noi 
' do. Consider the^sccond of these two sentences. , 

^ 5 Bauxite Is an ore. 

6 Bauxite looks like clay. 

Half the skilled adults changed the predicate looks like clay into an adjec- 
tive, |c;ia{//t*e ore. The youhger students did not do so nearly as frequently. 
In fact, the number of occurrences from youngest grade to oldest was: 1, 
2, 3/ 10, J4. This chapge begins to bloom only as late as the, tenth grade, 
where the frequency suddenly triples. But even as late as,the tenth grade 
only a fifth of the writers make the change, whereas among skilled adults 
hal^ do. So this is a late blooming accomplishment. (It probably is not 
acj^uaHy a transformation.) What in qifect has happened in this change is 
that the skilled adult has shifted the grammatical category from verb 
pllrase to adjective. 

/Older students make other syntactic category shifts more readily. For 
instance, our skilled adult changed the pre Ucate or verb phi^^ehasrnany 
f^es into a prepositional phrase, with many user. Still other older writers 
hanged that verb phrase to an adjective, useful Three-fourths of the 
killed adults dsd one or the other. But only half ♦he twelfth graders did, a 
ourth of the tenth graders; a fifth of the eighth ^aderi; aiid only a 
twelfth of the sixth graders. No fouuh grader did. So here again we have 
a highly discriminating measure of maturity, and a relatively late bloom- 
er. 

Francis Christe:isen» in his study of rhetoric, has sinj^ted out certain con- 
structions as being particularly indicati\'e of adulthoc<i. One of those ap- 
pears three times in this sentence which he cites from E. B. White. I have 
italicized the key words. 
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We caught two bass, hauUng them in briskly as Aough they were 
mackerel, pulftig'Aemwer the side of the boat in a businesslike 
manner withoumiy landing net, and stunning them with a blow on 
the back of the iWl. .: 

^Here we have four verbs wfth the same subject, all describing the same 
levent. The input sentences, r^uced to their skeletons would be thesej 

We caught two bass. ; 
, We hauled theni in briskly. 
We pulled them over the side."" 
We stunned them: 

lliese four sentences can be r educed to a^gle X-unitif we get rid of tfie 

repetition of subjects and add -fng to theverbs: 

\ f 

, We caught t\vo bass, hauling them ixHiriskly^puUingth^ * 

side, and sturming^diem. \ | 

Of the 300 persons who rewrote '^Aluminum," hot one of them produced 
lusuuMuytruction.,Out^^^^ **The Chicken,"^ 

not even one produced it. By 10 eighth graders whoV^ewrote it, it was 
produced once: 

She slept all the time, Jaying no eggs. 
By 10 twelfth graders this construction was produced twi^. Here are 
both examples. 

The chicken cackled, waking the man. 
Blaming the.chicken, he killed her and ate her 
^for breakfast. . 

But the university students produced 14 examples. In fact, 9 out ot 
university students studied produced at least one example, whereas only 
out of 10 twelfth graders had done so. In the little time between hij 
school and the university, this construction suddenly burst into bloom.^ 
pere afn some examples from those 14 occurrences. \ 

\ He caught the chicken, planning to eat it the next morning, and 

1 ^ placed it in a pen located below his window. 

1 The old man caught the chicken and put her in a pen under his 

: window planning to eat the chick^ fotbre^fast the next morn- 
ing. Early the next morning a soun^^wokethe man, and looking out 
the window, he saw the chicken and an egg. 
Living alone in his farmhouse, and without any neighbors, there 
was no one for him to talk to, so he passed his days working in his 

garden, growing vegetables and grain Thinking what a deli- 

cibu? breakfast the chicken would make, he caught her wcid put her 
in a pen putside.his window. 

^MeanT-unit length for -The C'hicken" is G4, 6.7; G6, 8.3; G8, 10.2; GIO, 10.9; G12, 12.0; 
University, 13.0. The passage can be^found in its entirety at the end of this chapter. 
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For our purposes here, this is a long enough list to demonstrate that some 
syndetic structures bloom early and some late. 

It seems likely that this theory of syntactic maturity applies to lan- 
guages other than English, perhaps even to all human languages.The "Al- 
uminum" study has been repUcated in the Netherlands by Reesink et al. 
(1971). Reporting their findings in Psychological Abstracts they conclude, 
*The similarity between Dutch and American chfldren in syntactic devel- 
opment is outstanding." 

Furthermore, an investigation into Pacific Island languages tod some 
Asian languages has begun at the East-West Center in Honolulu (Hunt 
1974, unpublished). The rewriting instrument already referred to as 'The 
Chicken," after being found to discriminate significantly between grades 
4, 6, 8, 10, and 12 in English, was translated into a number of Pacific Island 
languages and some Asian languages. Those translated versions y/ere«tiien 
rewritten by children aged about 9, 13, and 17, who were, for most lan- 
guages, native speakers of the language tested. So far, papers in Fijian, 
Indonesian, Korean, Laotian, and Marshallese have been scored for words 
per T-unit. For each of those languages the scores for the oldest group are 
distinctly higher than the scores for tfie youngest. The scores for the mid- 
dle group lie in between. The papers in Japanese have been scored, not 
for words per T-unit, but for number of S-constituen ts per T-unit, and the 
results for Japanese are almost exactly the same as for English, supporting 
the theory. ^ 

ThCTe seems to be.no doubt that syntactic maturity, as measured here; 
can be^ enhanced by a sentence-combining curriculum. This seenis to be 
definitely established for grade four (Miller and NeyJt968; Hunt and 
O'Donnell 1970) and for grade seven (Mellon J9e^O'Hare 1973). For 
grade four, H6nt s curriculum covered seventeen bc'ntei\ce-combining 
transformations and included many multi-sentence embeddings. Students 
responded both orally and in writing. They not only combined sentences, 
as is done, at least hypothetically, in writing ariu speaking, but they also 
broke them back down, as is done, again at least hypothetically, in read- 
ing andJistening. At the end of the year, 335 students in th^ experimental 
and control sections were tested in several ways. On the - Aluminum" 
passage test, the number of input sentences consolidated per T-unit was, 
for control students, 2.6; for experimental students, 8.3. Such a difference 
is unquestionably significant, and would have taken about two years more 
jq accomplish had there not been this instruc tion. . 

In their free writing, experimental students wrote significanpy longeiT 
T-units, indicating greater niaturity. They also wrote themes about twen- 
ty to twenty-five percei)t4(Snger than those written by students in the con- 
trol group, thesesame students werp tested to see whether this curricu- 
lum affected their reading comprehension. It might be expected that the 
decomposing of complicated sentences into their underlying component 
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sentences would make^tudents more conscious of the syntactic problems 
in reading comprehension. The results of the posttestiiig were far from 
conclusive and far from complete, but at least the findings werie encour- 
aging rather than* discourages. On what Stedman calls a Reading Struc- 
ture test, the experimental stiments scored significantly higher than the 
control students at the end of die year. . , 

The elementary grades would sfeem to be an especially appropriate 
place to use a s'bntence-conibining curriculum; the use of many middle- 
bloomer transfonnations increases rapidly at this age. Surely it is possible 
to test whether a transformation can be taught at a certain age by a certain 
amount of repetition, or cannot l:^ taught atall until later. Bumiel, Go- 
me^/and Mey (1974) have ahready begun'to e^qp^riment on how to mea- 
, sure the teachability of a certain structure by a certain method at a certain 
age. Thus they report, for example, "the who/ which embedding was per- 
formed wifli a 401 error rate on die first day. By the third day, the students 
had improved, showing a mere 42 error rate. Some exercises, such as the 
embedding of conjoined adjectives, proved highl]^ resistant to^improve- 
m^t, manifesting a 50% j^or rate over four succeeding lessons (p. 219)." 
The kind of information given previously as to which structures bloonf:^ 
early and which bloom late would be prelimin vy to actual measures of 
t^chability at a given level. / - - 

In the mid-seventies, then, the English teaching profession has a theory . 
of syntactic development that covers a broad range of structures. It also 
has more than one way of measuring progress toward the goal of skilled 
adulthood. There is also evidence that curricula already known can en- 
hance syntactic maturity and perhaps assist reading comprehension. One 
might reasonably hope that a period of rich and varied curricular experi- 
mentation would now conmience. There are not many arete in the lan- 
guage arts where the goals are as clear and as measurable as in this area, 
and yet where so little experimentation has occurred. 

To the present time» the teaching of language has been guided almost 
exclusively by the rhetorician Vintuitioil. But the*theory of syntactic de- 
velopment reviejwed here does not rest upon intuition alone; it rests on a 
solid body of experimental data. Linguistics ,win be of vastly greater help 
to language teaching as it begins to be able to make such statements as: 
"This ^cture has this meaning in this environment for this reason." Up 
until now, only rhetoricians ha^^e made such statements, but their intuitive 
perceptions have often been vague. Linguists now are beginning to de- 
vote a great deal of attention to the meaning of surface structure differ- 
efices, to such matters as presupposition and entailment. As they begin to 
study the relation between syntax and semantics, they are approaching 
the rhetoric of the sentence. As they do so, they may be able io say less 
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vaguely some of the things rhetoricians have already said. And if they can 
say them less vaguely, they^can say them more teachably. When that hap- 
pens, we English teachers can Jbe grateful. -^t: • % 

The two passages from which some of the exercises in this chapter were 
drawn follow. 

. Aluminum 

. Directions: Read the passage all the way through. You will notice 
that the sentences are short and choppy. Study the passage and 
then rewrite it in a better way. You may combine sentences, 
change the order of words, and omit words that are repeated too 
many. limes. But try not to leave out any of the information. 

Aluminum is a metal. It is abimdant. It has many uses. It comes 
from bauxite. Bauxite is an ore. Bauxite looks Iflce clay. Bauxite 
contains aluminum. It contains several other substances. Workmen 
extract these other substances from the bauxite. They grind the . 
bauxite.. They put it in tanks. Pressure is in the tanks. The other I 
' substances form a massr They remove the mass. They use filters. A j 
liquid remains. They put it through several odier processes. It final- / 
ly yields a chemical. The chemical is powdery. It is white. The 
chemical is alumina. It is a mixture. It contains aluminum. It c5on- / 
tains^oxygen. Workmen separate the aluminum from the oxygen. / 
They use electricity. They finally produce a metal. The metal is / 
light. It has a luster. The luster is bright. The luster is silvery. This j 
metal comes in many forms. , j 

_ The Chicken 

Directions: Read the story all thi^ way through. You will see that it 
is not very well written. Study the stoiy, and then write it over 
again in a better way. You will want to change many of the seii- 
tences, but try not to leave out any important parts of the story. 

A man lived in a famihouse. -He was old. He lived alone. The house 
was small. The house wats on a mountain. The mountain was high. 
The house was on the top. He grew^ vegetables. He grew grain. He 
ate the vegetables. He ate the grain. One day he was pulling weeds. 
He saw something. A chicken was eating his grain. The grain^was 
new. He caught the chicken. He put her in a pen. The pei^ was 
under his window. He planned something. He would eat the chick- 
en for breakfast. The next morning came. It was early. A sound 
woke the man.. He looked out the window. He saw the chicken. He 
saw an egg. The chicken cackled. ITie man thought something. He 
would eat the egg for breakfast. He fed the chicken a cup of his 
grain. The chicken talked to him/He talked to the chicken. Time 
' passed. He thought something. He could feed the chicken more. 
He could feed her two cups of grain. He could feed her in the 
morning. He could feed her at night. Maybe she would lay two 
eggs every morning. He fed the chicken more grain. She got fat. 
She got lazy. She slept all the time. She laid no eggs. The man 
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got angry. He blamed the chicken. He killed her. He ate her for 
breakfast. He had no chicken. He had no eggs. He talked to no one. 
No one talked to him. 
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The renewal of interest in prewriting or invention among contemporary 
rhetoricians has led to an important contribution to. describing and mea- 
suring growth in writing: description of the intellectual strategies (or writ- 
, ing strategies) apparent in the written piece. A description of these strate- 
gies tells us, and the writer, what de^cisions the writer actually made in 
fixploring and presenting a particular subject. These decisions are pardy 
matters of .diction and syntax,,but they also involve more complex matters 
of classification and contrast, physical context, sequence, change, ana fo-* 
cus aifid chijige of focus. Replacing vague comments with specifics can 
lead writers to make substantial revisions involving reseeing and rethink- 
ing. Describing these strategies considerably enriches evaluation at a. 
number of leyels: diagnosis, formative evaluation in the classroom, and 
growth measurement. 
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A ^number of ct)ntemporary rhetoricians arfl(ue that if students are to im- 
prove their writing, they will need to increase their conscious use of cer- 
tain cognitive and affective processes during the prewriting stage of com- 
position. It is not adequate, these rhetoricians would cbtitend, to teach' 
students to organize and express existingjtdeas or even to teach them to 
recognize faulty syllogisms and distinguish between fadt and "inference. 
Composition teachers should show stuiifents how to ^falore, sensitively 
yet systematically, facts, feelings, values; and ideas in order to determine 
what it is they wish to say in their writing. This point of view is by no 
means universally held. More traditional rhetoricians such as Martin Stein- 
mann (1975) assume that rhetorical theory and the teaching of composi- 
tion are concerned only with effective^jpresentation of ideas, not with their 
formulation. But m recent years several researchers (Rohman and Wlecke 
1964;' Young and Koen 1973; Odell 1974) have pr^ented some evidence 



that 
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Composition teachers can help students incipease Aeir conscious use 
of certain intellectual (cognitive and affective) processes. ^^/-^ 
2 Instruction in the use of these processes (jaki result in writing that 
seems more mature, more carefully thou^t out, mbre persuasive. 

For teacher^,, this recent body qf. theory and research helps solve a re- 
current problem; it suggests ways of dealing, with' student writing that 
seems superficial, imperceptive, unimag^^tive. But for those who are 
concerned with describing and measuring students' growth in writing, 
this work in rhetoric presents new problems; How do we identify the 
intellectual processes implicit in students* wtiring? How do we determine 
whether students are using these processes.^as f u|ly and effectively as they 
might? ' 
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As with new questions in any field, tfiese pose so many difficulties that it 
is tempting to avoid asking them at/all possible. And in some cases, we 
might reasonably give in to temp^tation. If we are interested in summative 
evaluations of students' ability to produce writing that has certain charac- 
teristies (e.g., persuasiveness, in$ightfulness),^or if we are interested solely 
in predicting students' success jm college, we might not need to identify 
the processes by which they formulate the ideas or attitudes expressed in 
their writing. ^But if we want to make useful diagnoses or formative eval- 
uations of students' writing— that is, if descriptions of students' present 
writing are to be used in helping/them improve subsequent writing— we 
must have some insight into/the/r use, of these processes. !n making this 
claim, I am assuming that: 

1 . Although « thinking is a ccfmplex activity, the number of conscious 
mental activities involved in thinking may not be infinite; the rela- 
tively smallnumberpf intellectual processes identified by Kenneth 
Pike (1964 a and by lets us describe much of what people do con- 
sciously when iheyj examine information, attitudes, or concepts. 

2 We can identify linguistic cues— specific features of the surface 
^^^tructure of writteil orApoken language — that will help us determine 
'"^what intellectual processes ja, vmter is using. 

3 In order to improve students' writing, we will have to determine 
what intellectual/processes we want students to begin w^ing, contin- 
ufe using, or use differently; to make this determination, we must 
have a good sense of how, they are presently functioning. - ' 



^ Intellectual. Processes and Linguistic Cues 

Although discussions of intellectual processes described by Pike appear 
in a number of ppces (Pike 1964, a and b; Young, Becker, and Pike 1970; 
Odell 1973), I htfve two reasons for illustrating each of these processes, 
rather fully in this Aapter. For bne thing, these processes manifest theni- 
selves in a varietWof ways that are not made explicit in other discussions 
of Pike's work. Moreover, the linguistic cues described below are useful, 
but occasionally /ambiguous; in order to determine the significapce of a 
given cue, one must have a dear understanding of the intellectual pro- 
cesses it niay reflect. ^ < 

Focus. Pike i^laims that in order to observe, think about, respond to any 
phenomenon,ywe have to segment the continuum of phenomena, we have 
to focus upon distinct units of experience. **Without segmentation of 
events info recallable, nameable chunks, without abstraction of things as 
figure against ground, without reification of concepjs manipulatable as 
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discrete elements by our mental equipment, man woi'ld be inept" (Pike 
1964a)/ This process of segmenting and focusing occurs al! Ae time in 
movies and 'television. The camera zooms in to let us see the details of a 
character s facial expression, then moves back to tell us more about the 
character by letting us see his or her posture, gestures, clothes. Moving 
back still further, the camera shows us the character in his or her physical 
surroundings. We use this process in our own perception of an object, a 
person in real life, a character in a literary work; we shift our attention so 
as to focus on diose visible details that seem most significant. 

We don t always do this consciously, a fact that becomes clear for many 
o{ us when we first see a photograph we Ve taken ourselves. When we 
snapped the picture of, say, an infant, we were very aware of the tooth- 
less smile, the pudgy, rosy cheeks, the charming (to parents, at least) bit 
of drool on the baby's chin. But on looking at the developed photograph, 
we see a large expanse of living room carpet, a chair, a comer of a coffee 
/table, and," way in the background, a swaddled object that might possibly 
' be a baby. We did not do with the camera what we had unwittingly done 
with our mind s eye. VVe did not move in so that the camera could select 
the same visual detail that we had been so acutely aware of when we 
pushed the shutter. , 

This process of shifting focus and selecting detail is reflected not only in 
photography but in the syntax of our written and spoken language. If we 
examine grammatical focus— that is, the grammatical subject of each 
clause in a piece of discourse— we can learn a good bit about the way the 
. talker or writer is perceiving and thinking. Consider, for example, this 
. passage from Life on the Mississippi, where Mark Twain describes the 
steamboat as it approaches a small town. (Italics in thi$ and subsequent 
illustrative passages identify linguistic cues to the intellectual process be-, 
ing discussed.) 

. . .the furnace doors are open and the fires glazing bravely; the 
upper decks are black with passengers; the captain stands by the 
big bell, calm, imposing, the envy of all; great volumes of the 
i.\ blackest smoke are rolling and tuml^ling out of the chimneys— a 
^ jj^^ivV' husbanded grandeur created with ^ bit of pitch-pine just before 
\ * '^arriving at a town. ... 

" 'Grammatical subjects, of several clauses in this passage suggest a succes- 
sion ofcamera shots, a sequence of perceptions: the furnace doors, the 
upper decks, the captain, the volumes of smoke. 

George Orwell's essay, "Shooting an Elephant," shows grammatical 
focus being used in a slightly different way. 

When / pulled .the trigger / did not hear the bang or feel the 
kicki-one never does when a shot goes home— but / heard the 
devilish roar of glee that went up from the crowd. In that instant, in 
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too short a time, one wouid have thought, even for the bullet to get 
there,, a mysterious, terrlple change had </ome over the elephant. 
He neither stitred nor fell, but every line (of his body had altered. 
He looked suddenly stricken, shrunken, , iihmaisely old, as though 
the frightful impact of the bullet had /paralyzed him without 
knocking him dUwn. At last, after what seemed a Jong time— 
might have been five seconds,*/ dare sayj-Ae sagged ilabbily to his 
knees; His mouf A 'slobbered. An enormous senUity seemed to have 
settied upon him. One could have imagined him thousands of years 
old.* ' I 

As in the Tw^ain passage, some of the subjects in this passage have a single 
concrete referent, such as /, he, his mouth. But several of the subjects in 
Orwell's passage-^mystcrious, terrible change; frightful impact of the 
bullet; enopnous senility^do not reflect Orwell s .visual perception of 
single detaS^; instead they suggest OrwpIVs conclusions about what he 
saw, or his synthesis of individual details. 

In argumentative or expository prose, changes i^i grammatical focus 
^may reflect shifts in perception. They may also indicate a writer's atten- 
tion to various facets of a complex topic. Consider, for example, the fol- 
lowing excerpt from The New York Times Sunday Magazine about the 
construction of the Alaskan oil pipeline. 

For more than' six- years since the discovery of oil on Alaska's ' 
North Slope, thej press has emphasized and Washington political \ 
ieaders "have debated the environmental risks. Alaskans have heen^. ^ * 
largely preoccupied with the economic impact. But spalrse atten-'^ '^^ 
fton has been given to one price of the pipeline which can be la-' , • 
beled only witl^ a phrase verging on themacabre; tlie human toll, a ^ 
toll measured both in human despair and in injury and death. The 

casualtyjiffiiri^ pipeline-related workers may well turn out to 

beHBgher tHanTor any other major construction project in the na- \ 
tion in modern times. 

Initially, the writer focuses on those who have commented on the topic- 
journalists, politicians, Alaskans. Subsequently, he focuses on a significant 
failure of these commentators, and then on one main aspect of the con- 
troversy {casualty figures) they have neglected. 

Unquestionable, other parts of a sentence can reflect one's segmenting 
of the continuum of experience. But by dealing only with the crrammatical 
subject of each clause, we simplify our task in analyzing language and sirll 
turn up valuable information abouti the way a speaker or writer is think- 
ing. Moreover, the grammatical subject seems to have a special signifi- 
cance. Changes/in grammatical focus not only imply a shift in thinking or 
perceiving; they also imply a change in direction or commitment for the 
rest of the sentence. For instance, in describing the elephant's death, Or- 
well could ha^e written, "The bullet struck the elephant with a f^ghtful 

\ 

\ 
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impact." Instead, he saidj, 'The frightful impact of the bullet liad para- 
lyzed him without knockihg him down." By focusing on frightful tmpacty 
he was obliged to make an additional observation (the impact **paralyzed 
him without knocking him down/*). Similarly, in talking about the essay^ 
- we might say "Orwell opposed mmerialism." But if we were to focus on 
OrweVs opposition to tmp?riatem,\e would have to think further about, 
or at least make further comment aboUjt, Orwell s attitude toward imperi- 
alism. The syntax of the sentence would not permit us simply to assert 
that Orwells attitude existed. — : 

UngiHstic to use of focus: 
The grammatical subject(s) of each clause in a piece of discourse. 



Contrast. After focusing on some .chunk of experience/ we must, Pike 
argues, perform certain operations in order to understand it. One of these, 
contrast y entails knowing what an item (a word, a person, an object, a 
feeling, etc.) is nof, seeing how it difiFers from other items. Contrast is 
operating when we make distinctions, when we have a sense of incongrui- 
ty, or when we are aware of some disparity (between appearance and 
reality, .between the actual and the potential, between what we hope/ 

* fear/wish to encounter and what we actually do encounter). . ^ 
•> The Bebwulf poet provides early illustrations of this process. Just after 
Hrothgar has completed the mead hall Herot, the poet talks about the 

' monster Grendel: ..^ . 

Then, when darkness had dropped, Grendel 
Went up to Herot, wondering what the warriors 
Would do in that hall when their drinking >vas done. , 

He found them sprawled in sleept Suspecting — ^ . — 

Nothing, their dreams undisturbed. The i;ftonster s • 
Thou^ts were as quick /as his gpreed or his claws: 
'J He slipped through the^door and there .in the 
• silence / / 

Snatched up thirty m^n, smashed "thei;n ^ 
'^C'Unknotving in their beds and ran out with their 
bodi^, r 
The blood dripping behind him, back 
To his lair, delighted with his night's 
slaughter. 



In this passage taken from the Burton Raffel translation, the poet makes 
explicit the contrast between the unsuspecting warriors and the monsler 
who knows exactly what is about to take place. And the poet must assume 
that the audience will feel the contrast between the monster s actions and 
their, own sense of honorable battle. To reinforce the contrast between 
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Grcndel's actionsapd his audience s valuer, fhe poet notes that unlike or- 
dinary pe^le-^indeed, even unlike ordinary monsters— Grendel is 

'^^'^^ . r so set 

On murder that no crime could ever be enough. 
No savage assault quench his lust 
For evil. 



Cori&ary to Anglo Saxon custom, the monster comes^ 

seeking no peace, ofFeringy^ 

No truce, accepting no settlementTno price 
" In gold or land,. and paying the living 
For one crime only with another. 

Beowulf, too, is introduced through contrast. The hero is "greater/and 
stronger than anyone else in this world.'^ 

Sometimes contrast is the means by which a writer tries to convey an 
impression. When Huck Finn's Pap unexpectedly turns up in Huck*s bed- 
room at the Widow Douglas' house. Twain has Huck teU us that: 'There 
wartit no color in his face, where his face showed; it was white; not like 
another Man's white, but a white to make a body sickj a white to make a 
body's flesh crawl. . . ." Or contrast appears when people reflect upon 
their own experiences. In The South Goes North, Robert Coles records 
one young man's comments about his parents: 

My old man, he was no good. He drank all the time.- You can 
have it; I like beer, but I dont drink the way he did. They found 
hirn dead in sonrie alley: He was frozen to death, buried in snow. 
Can you beat that! And when they told her, my old lady, she didn't 
say anything. She didnt cry. She said she didnt even care. She told 
me my father really had been dead for five years, and th^ Lord was 
just too busy to noHce and call for him. I thou^t she was fooling 
me, but she twwn'f .^^y old lady, anything she si^ys, she means. 

When he thinks about his parents, the speaker is aware of several kinds of 
contrasts: those betwejeh tfie father's actions and the speaker's values (the 
^father was "no good" because he drank constantly); between the spealc- 
ei;'^^actions apd his father's (the young man drinks, too, but not as much as 
hfcTfather did); between what his mother did and what she might have 
done (she didn't say anything, didn't cry, .didn't care when his father 
died); and J>etween what appeared to be the case and 'what actually was 
so ("I thought she was fooling me but she wasn't."). In addition to these 
contrasts, a reader is aware of further incongruities— chiefly that the 
youiig man who condemns his alcoholic father is himself a heroin addict, 
and hence his estimate of his own moral qualities is perhaps less reliable 
than he might like to think. ' 
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W^uMc cues touse^of contrast: 
1 Cgiwecion 




but 

however 
nevertheless 
on the contrary 
on the other hand 



2 ComparaUve and Superlative Forms 


more/moet 


less/least 


3 Negative 




no^ 


without 


not 


nothing 


4 Negative AfExes 




anti- ^ \ 


il- 


im- 




in- ^^''^ 


-less 


5 Lexicon 





instead 
though 
although 
in spite 
despite 



-€r/-est 



UQ- 

nou" 
a- 



Noun, verb, adjective, and adverb forms of such words as contrast, paradox, dis- 
tinctiont difference, and their synonyms. 



^ Classification. Almost at the same time we think about the differences 
^••J bet^veen X and Y, we have to think abont their similarities. We have to see 
how people, actions, feelings, or ideas can be labeled or compared with 
--..pther things. We have to think about what X reminds us of, what it has in 
commoajA^th otf^ items in our experience. At worst, this canrjsulftn a 
simple-mindedTedtictionism, which leads to ignore tfi^-uiiiqueness of 
some phenomena and leaves us open to the charggAstTwe are stereotyp- 
ing. JhU^danger notwithstanding, we can^jwirtie that one important way 
knowing a;>ything, especially sjixacflJmg unfainiliar, is to Jcnow it in 
terms of something else. 

One familiar formpf<llassifying appears in the following passage from 
H. M. L(imian$ky?fti^nslation of Chaucer s "the Millers Tale.** The Mill- 
er is d^sefimng one of the characters in his tale. 

The young wife was pretty, with a body o$4MJSt and graceful as a^ 
weasel. She wore a checked silk b^U^and arourd her 'loins a . 
" flounced apron as white as freshjwiflT . . . her singing was as loud 
and lively as a swallow's^tifig on a bam. In addition, she could 
skip about and playjik^ny kid or calf following its mother. Her 
mouth was a^s^y^^Tas honey or mead, or a pile of apples laid up in 
hay or h^th^ She was as skittish as a young colt, and tall and 
ghtas a mast or wand. On her low collar she wore a brooch as 
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broad as the boss on a shield. Her shoes were laced hi^ on her 
legs. She wot a primrose, a trillium, fit to grace the bed of any lord 
or to many any good yeoman. - ■ ; ^ 

I do not cite this passage simply to give English teachers still another 
lessen in metaphor. I mean siiaply to suggest that metaphor (I use the 
term to include analo.t(y and simile— any statement that asserts or implies 
that X is like Y or that X and Y share some common trait) is not simply a 
linguistic embellishment or a poetic refinement. The Miller's analogies 
reflect his own chauvinistic understanding ot this young woman; when he 
.thinks of her, he does so in these terms. As is often the case, his metaphors 
are an essential part of his understanding of -his subject. 

Another form of cIassification<1s suggested by tho following group of 
letters (Simon 1962). 



A 
C 

M N 



•0 
R 
T 
H 
J 



B M N 
D 0 P 
A 
C 
H 
j 
R 
T 



R 

T 

B H 



D 
I 
K 
S 
U 



H I- 
J K 



J 
A 
C 

M N 



S 

u 



0 P 



R 
T 

B M N 

D 0 P 

A B 

C D 



At first glance, this appears simply to be a random array of letters. But a 
closer look suggests that flit letters are not random, they appear in pat- 
terns; certain..*elationships appear more tlian once. For example: 



A B 


M N 


R S 


H 


I 




A B M N 


R S H I 


C D 


£LE 


T U 


J 


K 




C D 0 P 


T U J K 


M N 


A B 


H I 


R 


S 




M N A B 


K-I- R S 


0 P 


CD 




T 


U 




0 P C D 


J K T U 


R S 


H I 


A B 


H 


N 




R S H I 


A B M N 


T U 


J K 


? P 


Q 


P 




r. U J K 


C D 0 P 


H I 


R S 


M N 


A 


B 




H I R S 


M N A B 


J K 


T U 


0 P 


G 


D 




J K T U 


0 P C D 



A B M N 
C D 0 P 
M N A B 

0 P'C D 


R S H I 
T U J K 
H 1 Ti S 
J K T U 


R S H I 
T U J K 
H I R S 
J K T U 


A B M N 
C D 0 P 
M N A B 
0 F C D 
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Tbc point is, of course, that apparently complex phenomena cmJb^ sim- 
plified wBen we recognize that some patterns exist and ^^tHiiey are re- 
peated. If we could not do this, we would have greattr6uble in thinking 
' aBSut^-^deedreveh in remembering— reaUy conn^lex experiences. Th^ 
plot of A Midsummer Nigjhfs Dreamy for example/is incredibly compli- 
cated. It requires that we-keep trade of several love stories Uiat . inter- 
weave confusingly and implausibly. Yet the play becomes reasonably co- 
' , berent, almost simpl^-^hen we label recuneiit motifs: for example, 
blindness, that caused by pareital pride, by lovie, by egotism, or by magic 
^__ootion. 

$emanti^s|gj)ave pointed out how labeling influences thought. Saying 
'T am loser^'is quite different from saying "I lost the last two matches I 
played.** And the difference is not, as S.I. Hayakawa notes, merely a mat- 
^ ter of semantics (1072). The second statement comments only on die past. 
The first statement comments on ttie past and makes a prediction {often 
eiDough self-fulfilling) about die futiare. j , 

The infliienciB of labeling— sometimes a helpful influence, sometimes a 
J harmful one— api^^ars dramatically iin people's efforts to solve problems. 
Consider, for exsunple, students' work with die following' problem, an 
extremely simple one when compare^d with the difficult social, moral, and 
- , personal problems we have to deal with mo^t of the time. Two strings are 
^/^uspended from a ceiling, perhaps ten or twelve feet apart. They are long 
enough so that, if one thinks imaginatively, a sin^e person can manage to 
, tie them together; but the strings are nist short enough and just far enough 
apart so that one person cannot sim^y take hoM of the' end of one string 
and walk over and grasp the other. The problem is to bring the two 
strings together, receiving no help from anyone else and using only 
objects— usually a book, a pencil, and perhaps a chalkboard eraser— that 
; have been left on a nearby table. One student who vqlunteered to try to 
solve this problem first tried to draw one string out to its full horizontal 
length and then reach to the other string. He couldn't quite reach far 
enough. He picked up the book on the table and usedit as an extension of 
his reach;^ sl^ll no luck. He next picked up the pencil, clamped one end of 
it in the boolci and tried to u^e the combination of book and pencil as a 
^ further extension of his reach. / 

The student solved the problem only when he reclassified, relabeled the 
pencil. Instead of thinking of it as a device to extend his reach, he thought 
of it as a weight, a pendulum weight! He then tied this weight to the end 
qf one string and set it swinging back and forth. Next, he walked over, 
look tJie end of Jhe other string, and walked back toward the first string, 
which swung neatly into his outstretched hand. 

This sort of example, unfortunately, carries the danger diat we will'do 
our own labeling: 'That's only an experiment, a trick, a clever gimmick." 
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Having thus labeled it, we can dismiss it and, ironically, provide a further 
example of the point I want to make: labeling is not just a matter of se- 
mantics; it is a fundamental part of our thinking. . 

Linguistic cues to use of classification: 

. 1 Syntax ' " \ 

Sentences in which a linking verb joins a su^j^ ^^ith a predicate nominative. 
(My assumpUon here is that one of the noun phrases, either the subject or the 
predicate nominative, labels the otj^orrthat is, one of the uoun phrases suggests 
a more general clas^, of which>he other noun phrase is an instance or example.) 

2 Use of Phrases ^ 

for example ^^^^ for instance 
an example,/^ an iitstance 

3 Le^ip 

^oun, verb, adjective, and adverb forms of such words as «mi7or, rescmhUy and 
c/(M«, and their synonyms. 

. Not ail the cues for contrast and classification are in themselves defini- 
tive. The significance of a cue may well be determined by the lexical 
context in which it appears. For example, accurate scoring could not be 
achieved simply by counting the individual cues in the following sen- 
tence: "They were more and more dissatisfied, but yet they were not in- 
terested in escaping from their predicament." Here, the linking verbs are 
not followed by predicate nominatives and thus do not indicate classifica- 
tion; the contrast cues "more," "more," and "dis-" suggest, when consid- 
ered together, one reference to change rather than three references to 
contrast; and the phrase "but yet" is one lexical unit, suggesting one con- 
trast, not two. Clearly, then, linguistic cues are simply a means of direct- 
ing one's examination of a statement. One's sense of the meaning of a 
given statement must, finally, be the basis for determining what intellectu- 
al strategies have been used. It seems clear, however, that attention to 
linguistic cues can help judges agree as to what intellectual strategies are 
reflected in a written passage. When scorers were given linguistic cues in 
context, I found (Odell 1974) that scorers, working independently, could 
achieve 88* agreement in identifying the intellectual strategies an essayist 
Was using. 

Change. When Lady Macbeth fir^t proposes that Macbeth murder Dun- 
can, Macbeth hesitates, first citing the constraints of social and moral or- 
der, and then acknowledging his fear of failing at such a monstrous under- 
taking. But late in the play, after his second encounter with the witches, 
Macbeth resolves, *The very firstlings of my heart shall be/Th firstlings 
of my hand.'* Murder—not only of those who pose an immediate ^hreat to 
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his ambitions but of children who may someday pose a threat— no longer 
gives him th^ slightest pause. Lady Macbeth, of course, undergoes equal- 
ly extreme changes in exacdy the opposite direction. By the end of the 
play, her'**undaunted metde" has dissolved. Completely undone by the 
enormity of her crime, she evokes only pity from the doctor and gentle- 
woman who observe her sleepwalking. 

To understand either of these characters— indeed. Pike would contend, 
to understand anything— we must have a good sense of the nature and 
extent of Ae dianges they Undergo. For practical purposes, we assume . 
that people, places, ideas remain essentially constant. In order to survive, 
we have to feel diat diings will be recognizable from one day to the next, 
that rules^ governing our existence will remain pretty much the same, that 
past experience >yill let us predict with some confidence what we may 
expect in the future^ Yet we are amused, saddened, even horrified when 
--someone denies the fact of^ change and carries that denial to its logical 
conclusion. A recent newspaper carried this caption underneath a picture 
of a famous star of western movies during the 1940s and 1950s: 

' Roy and Dale!? Yup. Though Trigger is long since stuffed, the 
old straight shootei; is riding hard ... has a new movie, a restaurant — 
' chain, and maybe million, ** When my time cmnes, I want Dale 
to skin me and put me right up there on Trigger, just as if nothing 
had ever changed." 

One hopes that the old straight shooter is being facetious. But serious or 
not, he helps make my point. Change is part of our experience; awareness 
of change is crucial to an understanding of experience. 

Sometimes this awareness is painful. A policeman in Robert Coles* The 
South Goes North makes these comments (italics mine throughout): 

Do you see what has happened to this country in the last few 
years? The militants say they're going to bum their own neighbor- 
hoods down, and they're also going to start coming to our neigh* 
borhoods. Can you beat that? ... I told my wife the other day that 
before we're out of this mess, theyll be setting more and more 
fires. Therell be fires everywhere in the ghetto, apart from when 
tfiey riot, and theyll start slipping into our part of town. It'll mean a . 
lot of work for me; no fooling. 

The prospects of new social values, changes in his ^ork, changes in the 
neighborhood, even in the country itself are as upsjBttirij^ to him as a dif- 
ferent sort of change was to Mark Twain when, servingias a "cub" pilot on 
a steamboat, he. was trying to learn to navigate the Mississippi River. , 

I went to work now to learn the shape of the river; and of all the 
eluding and'ungraspable objects that ever I tried to get mind or 
hands on, tha^ 'was tihe chief. I would fasten my eyes upon a sharp. 
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. wooded point that projected far into the river some miles ahead of 
me; and go to kboriously photographing its shape upon my brain;^^ 
and just as I was beginning to succeed to my satisfaction, we^ould 
draw up toward it and the exasperating thing would-begm to melt 
away and fold back into the bank! If th,ere had Seen a conspicuous 

• dead tree .standing upon the_yer>rpomt of the cape, I would find 
that tree inconspicupuslyTnerged into the general forest, and occu- 
pying the^middie of a straight shore, when I got abreast of itl No 

jMcomlnent hill would stick to its shape long enough for me to make 
^ up my mind what its form really y^as, but it was as dissolving and 
changeful as. if it had been a moimtain of butter in the hottest com- 
er of the tropics. Nothing ever had the^ same shape when I was ^ 
coming down*stream that it had borne jwhen I want up. 

As he learned to deal with this sort of change. Twain had to reconcile 
himself to an even more profound change. After describing a really splen- 
did Sunset, he remarks: / t . 

I stood like one bewitcHed^^itank it in, in a speechless rapture. 
. The world was new to me, and I'had never seen anything like this 
at home. But as I have said, a day came when I began to cease from 
noting the glories and the chs^is which the moon and the sun and > 
the'twilight wrought upon the river's f ac * another day came when 
I ceased altogether fo note them. Then, if that sunset scene had , 
been repeated, I shoulcl hay^Jooked upon it without rapture, and 

' should have conmiented upon it, inwardly, after this fashion: *This ^ 

sun means that we are going to have wind to-morrow; that floating. \^ 
log means that the river is rising, small thai^s to it. . . /* 

. ' 1 

Liriguiilip cues to ref€rence4ochange: ^ • 

1 Verb, noun, adjective, or udverb forms of the word change or a synonym for change. 

2 Verb phrases which can bev^ausibly rewritten so as to include become (e.g., realize^ 
become auxire). ^ \ / 

3 Verb phrases which ii\c\ude began (or^a synonym) or stop (or a synonym) plus a 
verbal (e.g., "I began to cease from noticing. . . '*). 

Thy sicat Context. As Beowulf lies waiting for Grendel to make his visit 
to Herot, the poet gives us a first look at Grendel— or rather at the sur- 
roundings in which Grendel characteristit^ally appears. 

Out from the. marsh, from the foot of misty 
HiUs and bog5, bearing God s hatred, 
Grendel came, hoping to kill . 
? Anyone he could trap on this trip to high Herot 
He moved quickly through the cloudy nigjht. 
Up from his swampland ^ sliding silently' 
Toward that gold-shining hall. v 

Later, Beowulf and others track Grendel's dam to her lair. 
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Mdjere clumps of /reej.bent across 
Cold gray stones, they came to a dismal 

t Wood; below them was the lake, its water 

Bloody and bubbling. 

. They looked down at the lake, felt ' j 
How its heat rose up, watched the waves i 
Bhod-stakied swirliiig. Their battle horns sounded, 
Then sounded again. Then they set down their weapons. 
"Th^ could see the \vater crawling with snakes, 
* FarUasHc serpents swinmiing in the bolfing 

^^^LoJte, jlnd sea bexists lying on the rocks, . . . \^ 

The poet hardly needs to describe the monsters. He simply describes the 
physical con^xt in which one typically finds them; our imaginations can 
do the rest. * i . 

Often enough, we sl&e physical context used to influence our feelings. 
Cadillac ads locate the car in plush surroundings; President Nixon usually 
delivered televised speeches surrounded by an American flag, a bust of 
iincob,' anda picture of his family. Perhaps the classic illustration of the 



importance of jphysical context appears in the movie Blow-up. Examining 
a picture he has taken of a park, a phqto^apher discovers what appears 
to be a body lying in some ba^es^ He enlarges one section of the photo- 
graph, blowing it up until he has a picture of what is clearly a dead body. 
In the process of enlarging the picture, he has had to remove all physical 
context so that he can make the myjsterious object large enough to identi- 
fy. When his.studio is burglarized, he is left with therone large picture of 
the dead body and a peculiar dilemma: he has proof that a murder has 
been committed but no. way to prove to police that the body was ever 
located where he said it was. A picture of a body, removed from its physi- 
cal surroundings, is almost meaningless to him and useless to the police. 
^ ^ ' ^ ' ^ 

Linguistic cues to physical context: 

Nouns that refer to a geographical location (e.g., the name of a city, a geographic 
region, a point on a map), an object in a physical setting (e.g., a house or tree), a 
^sensory property of a physical setting (e.g., the sound of wind in the^^ees). 

Sequence. A ninth grader writes of a really frightening experience: 

Once; When I was nine years old I was upstairs in my house all 
alone washing T.V. It was about 10 o'clock^ my mom and dad 
said they would be back at 9 o'clock. The monster movie that was 
on T.V. Was "the man with a 1,000 eyes.'* The monster was a while 
glob with etyebalk all over him. It would go airound killing people 
in dark allevs. This move was about the spookiest movie I had ever 
seen.v^ was watching a part when the movie was playing the 
spooky music when I knew something was going tb happen,— like 
a man was going to , get killed. Then I heard a creak from down 
stair/. .././' 
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Under niost circumstances he probably wouldn't have worried about the 
"noise; he mi^t^'of even have heard it al all. But on thirparticular occa- 
sion, the noise becomes frighteningly significant because the student lo- 
cates the noise in several sequei^cesrl)"tiie-se qu e uce of liia» Wgflife==fae's 
old enough to be left alone at home but not old enough to be completely 
confident; 2) the sequence of his parents* actiorxs— the noise occurs well 
after his parents were supposed to be home and, presumably, after he has 
had opportunity to become a little bit nervous anyhow; 3) the time se- 
quence of the movie— the noiseliappens just when the "spooky music** is 
playing and just when he knows something horrifying is about to happen 
in the movie. 

What is true for our understanding of a sound; of course, is also true for 
bur understanding of/reaction to a person, an idea, an experience. Near 
the end of John Steinbeck*s novel Of Mice and Men, George is repeating 
to Lennie the familiar story of the farm they will someday have. 

**Go on," said Leunie. **How*s it gonna be? We gonna get a little 
place.** 

"Well have a cow,** said George. ** An' we*ll have maybe a pig an* 
chickens ... an* down the flat well have a . . . Utde piece alffidfa— ** 
*Tor the rabbits,** Lennie shouted. 
^ "For the rabbits ,** George repeated. 

^ _ ^ i "And I get to tend the rabbits.** " , ..^ . 

"An* you get to tend the rabbits.** 

Lennie giggled with happiness. "An' live on the falta the Ian*.** 

Listening to the story we are aware, as Lennie is not, of its location in a 
time sequence. We know that Lennie has just killed Curly s wife, that 
even as George is talking Curly and a group of other pursuers are closing 
in, and that George is about to shoot Lennie. We also know something of 
why George acts as he does—he doesn't want Lennie to suffer at Curly s 
hands. We furtfier realize that George is caught in an agonizing dilenuna. 
If he doesn't kill Lennie, Curly will. If George does kill Lennie, he will 
also kill the dream that gives his Ufe .meaning, the one thing that distin- 
guishes him from the other men. * - ^ 

Linguiilic cueslo reference to time sequence: 

Adverbial elements indicating that something existed before, during,' or after a 
moment in time. For example: 

then later previously 

when meanwhile earlier * , 

next subsequently ^ at that moment 

LitiQuiitic cues to reference to logical sequence: , \ 

1 Words implying a cause-^efTect relationship. For example: 
because » since 

therefore _ consequently . . 

2 The phrase t/ . . . then .... 



Measuring Conges /in Intellectual Processes JSX / 

^ ^ . / Describing Student Writing / j 

By identifying^intellectual^tocfesses reflected in student writifig, we 
can accomplislT three slightly different but related objjectives: making 
, qualitative dis/inctiohs between pieces of writing done in the same mode 
and for the /same audience; diagnosing writing problems; measuring 
growth in /writing.. - . " 

^ Making QualitJtive Distil ' / 

Consiaer^ese two pieces; the first is by an eleventh gradpr, the second 
by a welfih/^prader. 

^ A Swingin Dance 1 ' 

'Yesterday, my boyfriend and I went to a big dance in Detroit. 
When' we walked into the place, it was real noisy because eyeryone 
was talking and dancing. The dancing area was a lot bigger than 
most of the other ones IVe seen, butSie air was filled with smoke 
that would choke a horse. While looking around, my boy-friend 
noticed a few of his friends across the room, so we^vent overithere, 
and he introduced them to me. They were the coolest guysJ^After 
talking a while with them, Fabian came up.to me and asked me to 
dance. I just about died! I thought I was going to faintybu^ I pulled * 
through. He s the most! I thought that my boyfriend yas becoming 
a little, jedous because of my reaction to Fabian, so I decided to go 
dance' a dance or two with him. I danced off and oh with him and 
soinVother boys the rest of the eveningrOn the way home I told 
him that IVe neve/ had suchli'riot at a dance before in my life. I 
don t know if that made him happy or sad." / 

- / / 
Bestof^ets ' 

The bright beams peer ahead into the late dude; I am driving 
home, Carlisle to Newcastle. Far^ houses here along the road are 
far apart, and as I pass the few distant windows filled with light, I 
doubt that any inside are aware of my passing. 
' For a moment I ride the crest of a long hill; theni part way down, 
the lights play over a dim shape, alien to the rolling landscape. The 
car rolls to a stop beside it,/tte still figure of a well-gropmed dog. 
There is a little blood; only ^a wound on the jaw and the angle of the 
head indicate more or less than sleep. Likely less than an hour ago 
you left a nearby house/ gone for a walk. They won't really be 
concei ned till bedtime when -you aren't there to curl up on tlie rug. 
Perhaps your owners should be told that you won t be coming 
home tonight, that you won't come running to the familiar call, or 
lie under the dinner^table, or track mud into the house anymore . . 
Perhaps ... 

But what good would it do— And which house . . .? No. it seems 
best 1 go my way. You 11 have to wait here till youVe found. Until 
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then, for what they know, you're sTill out, soon to come home, and 
UfewiU be the'same. ^ 

'^e car starts, the beams again clearing a path, and I drive on, 
now for some reason slower than before, thoughts of my destina- 
tion, and faint relief for other commitments just not able to . . block 
. . the thought . r . • /. / 

Each of these t^yo pieces has certain problems. But, assuming that botK 
writers, are trying to share an expedence ^th an audience that doesn't 
have firsthand knowledge of that experience, '*Best of Pets" seems superi- 
or to "A. Swingin' Dance." DiflFer^nces in word choice and syntax help 
account for this value judgment. But even if I disregard these differences, 
the latter essay , still .s^ms more perceptive, more carefully thought out, 
the ''Best'ofTets** writer appears to have made more frequait and more 
appropriate use of certain intellectusUprocesses— /ocf«, reference io phy- 
sical context, reference to sequence^ and contrast. Differences between 
the two writers* use of classification and reference to ctunge are. small and 
do not seem directly related to the essays, effectiveness or lack of effec- 
tiveness/ V " 

^ Focus. ' , 

"Best of Pets" **A Swingin' Dance" 

bright beams (2) My boyfriend and I (we) (3) 

I (6) It (place) 

farmhouses ^ everyone 

any , " dancing area 

lights , . 'I (11) 

the car (2) air 

wound on the jaw and angle my boyfriend (he) (3) 

of the head They 
You (dog) (6) Fabian (he) 

they (owners) (3) . that 

'life. ' . 
thoughts of destination **• 
. and faint relief 

Both writers focus on /, as we might expect since they are writing about 
their own ©cperience. ,But the "Best of Pets" writer focuses on himself 
. only about 25% of the time; the "Swingin Dance" writcjr.f ocuses on herself 
about 40% of the time. For certain purposes— especially if one were trying 
to create a highly egocentric persorm— this frequent focusing on oneself 
seems appropriate. But the high proportiq(n of clauses focused on / de- 
creases the number of clauses that might focus on important aspects of 
the experience the writer is trying to convey. In focusing less frequently 
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onhimself, the**Bestof Pets"^v...'^r isableto focus on, and make observa- 
tions about, details (the dog, the farm houses, the car lights) that make the 
-incident memorable. Moreover, the **ffest of ?ets" writer shifts fpcifs in- 
terestiiigly. He not only focuses on the car but also on the car s lights, not 
> only on the dog but also on a wound on the [dog's} jaw and angle of the 
, head. By focusing not only on an object (dog, car) but on some specific 
facetxof that object {lights, wound), he gives a sense of shifting attention, 
takingsa careful look at what he's describing. 

Physical C^ontext- 
. "Best of Pets" 

^ ' ^ , ^dusk. 

Carlisle 
^ . .Newcastle 
farm houses ' 
* road 
windows 

crest of a long hill 
dim shape 
landscape 

still figure of a well 

groomed dog 
house (3) 
rug 

dinner table 
mud 

At the beginning of each piece, the writers, in effect, set the scene for 
their experiences by referring to physical context. But the "Swingin* 
Dance" writer does so less effectively than does the writer of *^Best of 
Pets." Of the seven references to physical context in "A Swingin Dance,*' 
only the smoke-filled air and the large dancing area are distinctive fea- 
tures of the place she is describing. Tlie other references to physical con- 
text (Detroit, the place, the room) are so general that they don't contri- 
bute anything to one's understanding of the writers experience. 
Moreover, physical context has little to do with her feelings (she's more 
impressed with Fabian than with the dancing place) s^nd it has nothing to. 
do with the predicament she was in (her references to the dancing ^area 
don't heighten our understanding of her conflicting feelings about Fabian 
and her boyfriend). In "Best of Pets," however, all of the first nine refer- 
ences to physical context help establish the writer's sense of loneliness and 
isolation. Even if a bit sentimentalized, subsequent references to the dog's 



**A Swingin* Dance" 

Detroit 

the place (2) 

the dancing area 

air ' 

smoke 

room 
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accustonr^ed setting (house, rug, table) help readers understand why the 
dog wasAvorth the writer s concern. Consequently, references to physical 
context ,nelp readers understand the writer s dilemma; he's in a physical 
context whtic a uc'sirable course of action (locating the dog's owners) is 
not a feasible one. 

■ 7 ■ ' ' ' 

Sequence, • ' 

"A Swingin* Dance" 

time sequence 

yesterday [we] 'went 
When we walked in . . . it was 

noisy / 
While looking around, [he] 

noticed 
After talking . . . Fabian 

came up 
a dance before 

causal sequence 

real noisy because everyone 

was talking 
boyfriend [was] jealous 

because of my reaction 
jealous ... so [therefore] I 

decided ' 
made him [caused him to be] 
happy or sad ; 

In "A Swingin Dance,** three of the five references to time sequence 
locate actions (Fabian's appearance) and perceptions (noise of area, boy- 
friend's notice of friends) \<^ithin the time sequence of the experience the, 
writer is describing. Two of these refer to actions or perceptions occur- 
ring simultaneously (e.g., when we walked in, it was noisy). Moreover, all 
of the writer's cause-effect relationships occur within the time span of the 
evening. For example: Cause—- boyfriend appeared to become jealous; 
Effect— she decided to dance with him. She does not suggest ways the 
present experience might have been influenced by previous events; nor 
does she speculate about how this experience might influence subse- 
quent events, feelings, actions. By contrast, the writer of **Best of Pets" 
frequently speculates about events that precede or follow his finding the 
dead animal; eight of his eleven references to time sequence suggest 
events occurring in the past or in the future. Although his references to 
previous or subsequent events are not inherently good or bad, these ref er- 



,/ "Best of Pets" 

/ time sequence 

f as I pass ... I doubt 

/ For a moment^l ride . . . crest 

less than an hour ago you left 
/ won t ... be concerned till 

bedtime 
[become concerned] when 
' you aren t there 
[not] coming home tonight 
track mud anymore 
y'lit here till you're found 
Until then . you're still out 
soon to come home 
drive on, now . . . slower 
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dices seem very appropriate here. They help communicate the signifi- 
cance he attributes to the* animal and, 'consequently, help a reader under- 
stand why the writer feels so strongly about the experience. 

^ Contrast. 

"Best of IJets", 

^ more or less than sleep 
• . they wont be concerned 
you arent there 
you ipont be coming 
" . home 

you tt^on't come running 
come nmning or He . . . or 

track mud 
But what good would it 
dp 

NOy it seems . . . 
. . it seems best 

drive on . v slower ^ 

^ reUef . - ^no( able to block' 

thethou^t 
/ 

The **Best of. Pets" writer dwells chiefly on two kinds of contrasts; 1) 
contrasts between a customary state of affairs (dog <;omes home some- 
. time during the evening) and a new state of affairs; 2) contrasts between a 
'course of action thai seems right and desirable (trying to find the dog's 
owners) and a less attractive but more practical course of action (going on 
with his journey). These contrasts, combined with a final contrast be- 
tween what he would like to do (block out the thought) and what he 
continues to do (dv/ell upon the experience), seem very clear. lunder- 
stand what is different from/in conflict with what. In'^Swingin' Dance,** 
the contxgsts are less clear. She-contrasts the present experience witli her 
own previous experiences (other dance areas she had seen were not as 
large as this one; she had had more of "a riot" at this dance than at others 
she had attended) and she contrasts people^he meets (the coolest, the 
' most) with other people whom she does not identify. As was the case with 
" her repeatedly focusing on /, there are contexts (a conversation with or 
note to a close friend) in which her use of contrastis entirdy^pproxjriate; 
But, given her task of sharing an experience with someone who had no 
firsthand knowledge of that experience or of her previous experiences, 
her use of contrast seems less clear and less effective than does the "Best of 
Pets" writer s use of contrast. 
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"A Swingin* Dance** 

[area was] bigger than 
most 

' [area was big] but air was ^ ^ 
faied with smoke ^i 

Ihey were the coolest 
guys 

I thought ...but I pulled 

through 
He's the most " 
' Tve never had such a riot 
I don't know iiF Aat . . . 
happy or sad 
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Reference to Change. 



* 



** Best of Pets * • 
no references 



**A Swingin' Dance" 



I just about died 
boyfriend was becoming 



jealous 



. Althou^ he talks about a thing that has undergone a change and implies 
^ that a change has taken place within himself (he has Becc^m^.preoccupied 
C with the dilemma the dog presents), the writer of **BesroiPPets'',makes no 
explicit reference to change. The writer of **A SwingiA' Dance" refers to a 
change within herself and infers that a change has occurred within.her 
boyfriencj; she makes no references to overt^ physical changes in herself,* 
other people^ or objects. . ' ' ' " ' " \ 

Classification. * . • - 

"Best of Pets" "A Swin^n* Dance" ^ 

^ .We will be the same They were the coolest guys. 

The two writers make only negligible use of classificaHon. Neither 
creates any analogies. Neither uses the subject/linking verb/predicate 
nominatVe structure to label people or objects in interesting or unusual 
ways. • 

In order to show how analysis of intellectual stn^tegies lets us make 
distinctions between two roughly comparable pieces of writing, I have 
tried to give a fairly detailed example of how one might go about analyz- 
ing intellectual processes. In showing how this sort of analysis will let us 
diagnose student writing problems and measure students' growth in writ- 
ing ability, my discussion can be more succinct, 

Diagnosing Writing Problems 

The following essay represents a classic probleni in diagnosing and im- 
proving students' writing ability. 



The'college freshman of 1975 has many doubts and questions. 
**Is college what I want?" "What courses are best for me?" These 
two questions are common with thje college freshman and must be 
thought of seriously. 

"Is college what I want?" Often the freshman is pushed into fur- 
ther and higher education. It may not be what he really wants. 
Every graduating high school senior must seriously ask himself this 
question and make the decisiqn alone. The freshman will be more 
encouraged to succeed and achieve if he feels he has nxade the 
right decision. 



The College Freshman of 1975 
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; After he gets to college he himself, "What courses will I 
benefit from and which ones are required?" He often needs guid- 
ance from a counselor* If he chooses classes to his likmg, he vriH be 
happier and try harder' to^acWeve good grades. This has^a good 
effect on the freshman and will encourage him to stay in school. 

The college freshman today is no different from a freshman fifty 
^ears ago. Ihe fears are the same and the questions in his mind are , 
' puzzling. But if he has made the decision of furthering his educa- 
tion alone, then he has a far better chance of achieving his goal. 

The great difficulty with this essay is that, in some respects, it is not a 
bad piece of writing. The orgigiization is clear. And there are no errors in 
punCtuatibn pr spelling. But the paper is terribly dull. It gives no sense of 
the complexity, the drama, the interest of its subject. It reflects no real 
insight into .^e: topic. One could, of course, tell the student this— let her 
know that she hasn't done her subject justice, that she needs to think more 
creatively^ more profoundly, or one might resolve to devise future writing 
assigiunents that provide a clearer and more stimulating sen^e of audience 
and purpose. Each of these alternatives might be useful; I suspect neither 
is adequate. The care she took with the paper (her neat handwriting and 
careful proofreading of the draft she turned in) suggests that she's a rea- 
sonably conscientious, if uninspired, student. A change in audience and 
purpose for her writing would likely provide some inspiration and a rea- 
son to examine her subject more carefully and sensitively. But this change 
would not'help her understand how she might carry out such an examina- 
tion. If we want her to think better (more creatively, more profoundly^ 
more analytically), we'll have to teach her how. 

The process of improving her thinking will have to begin with our anal- 
ysis of the intellectual processes she is currently using in her writing. We 
should notice, for example, the superficial, higUy debatable classification 
in her last paragraph. (Are college freshmen today realty tlie same as. 
those of fifty years ago?) Notice, too, the simplistic hypothetical se- 
quences she sets up. (Does she honestly belike that Jf classes are to stu- 
dents' liking they will inevitably be happier in college? Surely there are 
other infiuences that are equally important in determining students' hapr 
piness.) Finally, note .that the subject of almost" every clause is terribly. 
general; she continually focuses on some mythical or composite creature 
(the college freshman of 1975) who has no individual personal reality for 
her or for her reader. 

As we get a sense of how she's dperating intellectually, we begin to see 
what we want her to learn to do. Her use of focus makes me think that sjie 
IS not terribly observant; she apparently does not know how to look (liter- 
ally, look) at real college freshmen and base her conclusions about them 
on her observation. Consequently, om important objective would be to 
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have her le«m to observe more closely hy learning to shift focus. We 
could have her find examples of this process by watchijng television pro- 
grams, noticing how the camera shifts focus, moving back to establish a 
physical setting, moving closer to capture the body language of a cfaarac- 
ter» moving closdr still to capture a small facial reaction. Or vye could 
teach her this process by having her work with pictures (or» better still, 
with overhead transpal'encies made from magazine pictures). We could 
ask her to us*e large pieces of construction papir to block out everything 
in the picture except details (a persons smile, thc^^expression in the per- 
son's ^es, a gesture) that say something impc^iant about the penon in the 
picture. As she learns to shift focus from onejimportant detail to another, 
we could encourageih^ to incorporate this process into her writing, mak- ^ 
ing these details tEe subject of each clause and, hence, the topic abou^ ^ 
which the rest of the clause must assert something. 

These suggestions for teaching are limited, because they ari; derived 
from a diagnosis based on only one essay. To be genuinely useful and 
valid, a diagnosis should be based on several pieces of writing. But this 
brief discussion of one piece of writing should 1) show how an analysis of 
intellectual [processes can supplement existing diagnostic procedures; 2) 
suggest ways this analysis might help a^student write more effectively in 
the future. 



Measuring Growth in Writing 

In two other chapters in this book, Patrick Finn s work with computer 
analysis of word choice and Kellogg Hunt's study of syntax, we find pow- 

'^erful methods of measuring students' growth in two important aspects of 
writing. Analysis of intellectual processed lets us describe changes in 

. another facet of students' writing— one that is not necessarily identified in 
Hunt's work or in Finn's. Syntax provides only a few cues to intellectual 
processes^ and even diose (e.g., coordinate conjunctiyDn cues^to contrast, 
such as but and however, linking verb/predicate nominative cues to class- 
ification) need not be associated with lengthy or coznpjlex sentences' Simi- 
larly, lexical cues to a given operation (e.g., not, change, when) need not. 
reflect a sophisticated vocabulary. 

The following passages, a ninth grader's initial and revised drafts of a 
personal experience essay, will help explain how analysis of intellectual 
processes can be used in measuring students' growth in writing. The first 
piece was written prior to^ the beginning of a six-week course of study 
(Odell and Cohick 1975) in which students were introduced to intellectual 
processes described in this paper. The second piece, the revision, was 
done at the end of the six weeks. 
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One time when Vc weiMt swimming my dad made ine and my 
brodier go off the high diving board. My brother yent off and 
. mideitback'tofliesideof thepool,but whenlw^t offldida 
bdlyflop and abnost drdwned. My dad had to com^in after me. I 
\ thouf^it I was going to die because I couldn't brea^e with all the 
\ water I swaDowed in me. , / > 

: v ^ When I! was about ei^t years old my dad i^ade me and my 
Wodier go off of tfiis hi^ diving board. When ^y brodier got to 
' ^^^ Ae top I bad butterflies because I kncvir I had to do it. I knew he 
woda nuJce it bailout of Ae pool because hJwas a bettCT 
mer dian ipe. Ht^ jumped in feet first because it was too high for 
him to dive from. It took about 5 steconds for/Wm to imerge. Then 
my dad made me do it the treads on die steps, were reassuring, 
^but die railing was slq>pery» so I leaned in Wlitde more dian usual. 
When I got to die top Hook at niy dad and he waved me on. Then I 
kx* at my broAer. He kwked at me Hke i^ was really easy. I tried 
not to bounce as much as I could. I finally got up enough courage 
to jump. I don't diink I heard anything Ground me because I was 
, conskitrating on die water. It looked a long ways down, but when I 
' was on die bottom it wasn't Aat far. When I jumped I did a belly- 
^ ' . flop wd I w^ in so much pain I almost cfrowned. I could feel 
someone tryiig to keep my head abbye water, it was my dad. 
When we got out I was coughing because I swallowed some water. 
My dad had a yfeeling sorry" lauA! 

The revision explores die experience much more fully dian does die 
ori^nal and reflects more effective use ^f several intellectual processes. In 
the revision, die nindi grader continues/to foci^pni; he even increases die 
proportion of clauses in which J is t^e subject: Yet he also increases die 
number of clauses focused on his father and brother, and each of diese 
clauses contains relevant information that was not in die Original. More- 
over, the revision contains two cWes which focus on important parts of 
die 'physical context {treads of stpps were reassuring; niiBng was slip- 
i Vpery) /these two references heighten one's sense of die writers predica- 
ment. / ' 

The student's references to physical- context, sequence, and contrast 
increase markedly in die revision. In diej^ed dmft, he makes four 
times as many references to nhysi^ c(Jntext, and at one point uses his 
failure to perceive physical surroundings as an indication of his internal 
state ("I don't diink I heard anything around me because I was consintrat- 
ing on die water."). In his sefcond draft, the student locates eight actions 
(as opposed to one in the ifcitial draft) within the time sequence of his 
narrative. He also cites five causal sequences, as opposed to one in the first 
draft. Finally, he uses a greater number of contrasts and more kinds of 
contrasts in die revision ^an in the original. In the first version, he notes 
on^ contrast between Wo actions (his brother's successful dive and his 
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own **bellyflop") and one contrast between a normaUnd a peculiar state 
of affairs CI couldn't breathe"). The second version contains six contrasts: 
one between his brother's swimming ability and his own ("He was a bet- 
ter swinuner than me."); one between twp impressions (the reassurance,, 
provided by treads on the ladder steps, and the danger inherent in the. 
slippery railing); one between an initial impression '^nd a subsequent im- 
presrion (**It looked a long ways down, but when I was on the bottom it 
waai't that far."); and three conbrasts between what he might have done 
and wh^t he did do (tried not to bounce^ leaned in more than usual, did 
^ not h^ much while concentrating on thVvvater below him). 

With regard to the student's reference to change and his use of classifi- 
cation, there appears to be no important difference between the original 
and the revised essay. But the substantial changes in his use of other intel- 
lectual processes help account for |He increased perceptiveness and effe<^ 
tiveness of the revision. On the b^is of these two essays, admittedly an 
extremely limited writing samplp, the student seems to be growing as^ 
writer. Analysis of his use of intellectual strategies gives us another helpful 
way of monitoring that growth. 

Questions Suggesting Further Study 
Quantity and Quality ^ / 

^ In each__oijheJwo pairs of essays discussed above, the quality of the 
essay seemed to be direcflyTelated to the number of intellectual processes 
reflected in tjie essay. Given information about the evidence and purpose 
for each pair of essays, classroom teachers and prospective teachers usu- 
ally think thlat "Best of Pets" is better than "A Swingin' Dance" and th^t 
the ninth grader's revision is superior to his original draft. Since my analy-" 
sis of intellectual processes would lead me to predict this sort ofresponse, 
I wonder; Can we often make this sort of prediction with confidence? 
When trying to determine which of two comparable essays is the superi- 
or, can we alssume that there is likely to be a strong connection between a^ 
reader's holistic judgment and the relative number of intellectual pro- 
cesses reflected in an essay? <> , 

Another sort of question arises from my analysis of the ninth grader's 
writing. As I suggested, the ninth grader's revised essay about a frighten- 
in&experience contains many more contrasts than does tho original paper. 
But the revision also contains more different kinds of contrasts than does 
the original. In the revision, the writer notes contrasts between two con- 
current impressions, between an earlier impression and a subsequent im- 
pression, and between a potential action'and the way he actually did be- 
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have. jConsequently, I wonder: Can we identify su^aTegori"^ for each 
intellectual process that will let us make finer discriminations betw.een 
two pieces of writuig? 

'Relation to Other Descriptive Procedures 

Given, the usefulness of descriptive procedures Finn and Hunt have 
developed, it seerhs important to ask several questions: Can the proce- 
dures Tve discussed complement theirs? Would a really thorough descrip- 
tion and measurem^i^of growth in writing need to include information 
about.word choice, syntax, and intellectual processes? Would such a de- 
scription ]^elp us make more adequate diagnoses or formative ev^ua- 
tions of students* writing? Would instruction based on such diagnosis have 
a greater effect on students* writing than instruction basejj.on a more li- 
mited diagnosis? ^ ' ^ , 

Developmental 'Considerations ^ / * 

In'Hunfs work, we have a comprehensive view of the development of 
syntactic fluency. Can we find equally significant developmental qualities 
in people's use of intellectual processes? Almost^certainly.anyone whpeaiT 
mAke a coherent ^statement can use at least some of the intelleptUal pro- 
cesses Fve described. But do people at different age levels use different 
intellectual processes? Do they use different subcategories of intellectual 
processes? For example, do seventeen year olds observe different kinds of 
contrasts than do nine year olds? If so, can we oblain, as Hunt did for 
syntax, a sense of what intellectual processes are possible for or likely to 
•occur at a given age? If so, could this information improve our teaching 
and measurement of composition? 



Conclusion 

As the preceding section suggests, the effort to solve one problem— that 
of finding way^ to describe writers* use of certain inCellectual processes- 
leads to new problems. Moreover, as we answer the kinds of questions 
iVe tried to raise, we will likely encounter new questions which make still 
further demands on our resourcefulness in^escribing and measuring 
growth in writing. As we meet thes^ demands, it seems almost certain that 
we will make important advances in measurement, in rhetorical theory, 
and in the teaching of writing. More sophisticated, comprehensive de- 
scriptions of written products should lead us to reexamine ourlfesic as- 
sumptions about written products and the process o^ writing. And this 
combination of improved theory and descriptive procedures seems to 
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offer our best hope of achieving one important goal of measurement and 
evaluation: making statements that describe accurately and usefully stu- 
dents* present writing and that have qlear implications for students' subse- 
quent writing. 
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The preceding chapters suggest procedures which students might be 
taught ta use iii examining their own and their classmates' writing. But the 
foUqwirig article is the/bnly one to give direct attention to two bajic ques- 
tions: Shbuld^e engage students in the process of describing andtti^i^ 
ing growth in writing? If so, how do we go about it? In response fS^c^e 
questions, Beayen gives a careful analysis of the rationale for and ai^- 
tages/disadvantages of students' participation in the process of e^irfiia- 
tion. FurtKer, Beaven describes three basic ways students might be in- 
volved in this process. Indirectly, this article speaks to concerns— such as 
diagnosis and sunmiative or formative evaluation— treated in other arti- 
cles. The unique contribution of this article is that it asks us to reconsider 
students' relation to the evaluation i)rocess and to share with students 
some" of the responsibility for describing and measuring their own growth 
in writing. • . 
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INDIVIDUALIZED GOAL SETTING, 
^ ■ SELF-EVALUATION, 
. . AND PEER EVALUATION 



^ Mary H. Beaven 



Introduction 

When one looks for research that might help classroom teachers evaluate 
student writing more effectively, not much is available that seems imme- 
diately applicable. In 1963 Braddock, Lloyd-JonesAnd Schoer wrote, 
**Research has so far given no clear in&cations of th^ost eflScacious way 
to mark papers." Twelve years later, in 1975, Jerabek and Dieterich, in 
tlieir review of research on the evaluation of student writing, wrote; "In- 
sufficient r^earch has been done pn the subject, a fact which accounts for 
much 0^ oilr ignorance. But the little research that has been done is tpo 
seldom translated into classroom practices." 

However, as the other chapters in this book indicate, research is going 
^n, and important strides are being made in identifying various kinds of 
'iscours^^, analyzing the composing process, and designing ways to de- 
scribe and evaluate the stages of the process. Researchers are developing 
and renmng methods to evaluate writing for the National Assessment of 
Educational Progress, and Educational Testing Services is continuing iU- 
explorations. At colleges and universities, professors and their graduate 
students are devising ways to help classroom teachers look at writing and 
lespond to it. 

As I have worked with English teachers and as they have experimented 
and reported on their work with formative evaluation procedures in their 
classrooms, we have evolved three approaches for responding to student 
writing: individualized goal setting, self-evalu*»Hon, and peer evaluation. 
In these three procedures, the individual student, not the re5»earcher or the 
teacher ,yassumes a prominent role. 

As the student becomes increasingly adept at evaluating vyriting, he or 
she will be abljc to use many ways of describing/responding/evaluating, 
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some of which are outlined in the bther chapters of this book. For exam- 
ple; children in elementary school can begin to identify the thinking pro- 
cesses of comparing, contrasting, classifying, and sequencing as de- 
scribjBd by Odell in this book and then to experiment with these strategic 
injtfaeir own writing. Tbey can also learn to identify T-units and embed- 
dings and to com|)ine sentences as they write. They can analyze the levd 
,of Aeir vocajbulary, use some of the rating scales, and begin to view wrijt-^ 
ing holisticaUy. Older students can refine these abilities and go on to de- 
vise writing assignments that elicit a specific type of discourse and to eval- 
uate the results with the guidelines Lloyd-Jones suggests in his chapter. 

In the three methods of describing/responding/evaluating to be pre- ^ 
sentedin this chapter, the teacher serves as a resource peiSon or facilita- 
tor, and the individual stijdent assumes increasingly greater responsibility: 
judgmgl making decisions, and then acting accordingly. 

Basic Assumptions 

« 

Six assumptions underlie the three approaches to f oipiative evaluation. 
These assumptions derive from two basic premises. 

1 * Growth in writing is a highly individualistic process.^ 

2 Many procedures designed to foster personality growth also relate 
,to growth in writing. 

The first assumption is that, although many research stiadies dealing 
with the efficacy/of various methods of instruction have failed to show 
significant improvement in writing, improvement may occur over a much 
' longer periodj of time than the «x-, ten-, or even fifteen-week periods 
which teachers and researchers usually allow. Growth in writing occurs 
J- sbwly. , f 

* This assunlption is reinforced by those who have studied syntactical 
^ development and found that linguistic ability develops slowly. For in- 
stance, linguists and others studying oral language development in early 
diildhoodihave shown that children, once they begin using plural forms 
of noun^, may take from eight to nineteen or twenty months to achieve , 
mastery (Cazden 1972, pp. 41-47). Kellogg Hunt has found it reasonable 
* to look for changes in written .syntactical structures at two- and four-year 
intervals. ,^ — 

The second, assumption is^that through their evaluatory cor^ments and 
symbols teachers help to create an environment for writing. Some nega- 
tive comments may teach students that descriptions of certain topics, feel- 
ings, values, perceptions, etc., are taboo. For example, when I was in 
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grade school, one of my papers was returned with this comment: **I can- 
not grade thoughts such as diese. You niust write about something nice or 
pretty." Furthermore, if teachers pounce on mechanical and sentence er- « 
, rors, decorating a paper with red marks, students may begin to believoi 
that they have nothing acceptable to communicate. 

This assumption is supported by research indicating that the cre^aMc^n^Qf , , ^ 
a climate of trust is essential. Linguists interest^ in oral langu^ge^ddvel- 
opment 'in early childhood have shown that adult responses tpV<jHildKen*s 
verbalization a^ffect motivation to talk, amount of speeeK, and so on. 
Adults whp respond to the content and id^as of the ohiTd and carry on.-a . 
"conversation," regardless of the child's grammar or^,^iiiax, are reinforc- 
ing positive language development, the motivafi9n}to talk, the desire to 
have "something to say," and the ability to experiment with language, 
stretching it to accommodate an expressive need (Gazden 1972). In one 
study on writing, done over a ten-week period, the results showed that; 
stuclents who received only positive commentary on their papers devel* 
oped a more positive attitude toward writing than those receiving nega- 
tive commentary (Stevens 1973)/ 

My next two assumptions are related, since they both refer to character- 
• istics found in people who have an achievement syndrome, "a cluster of 
traits that relate to the way a person goes about attaining his goals." In 
continuing the above description of such a person, deCharms (1968,' 
p. 232) has written: ^ 

Research has given us a picture of a man with high achievement 
motivation. He is the man who takes moderate risks, attains his 
goals tluough energetic and novel instrumental activity, likes to 
take individual responsibility and to know the results of his actions 
and plans, and organizes his life and is concerned about the use of 
• his time. 

Risk-taking, trying new behaviors as one writes, and stretching one's 
use of language and toying with it are important for growth in writing. 
Rogers (1962) describes the fully-functioning person as one who prefers 
growth to safety, seeking opportunities for "play" with perceptions, ideas, 
emotions, modes of expression, etc. According to Maslow (1962 and 
1971)^ risk-taking is a trait of self-actualizing people, a trait which can be 
developed as teachers provide the necessary environment, opportunities, 
and interpersonal support. Maslow (1971) states that through participa- 
tion in the creative arts people develop risk-taking abilities, becoming 
more fully-functioning; he argues that education should be centered on 
participation in creative expression in all the arts, writing included.' 

Goal setting is also an important process in the development^^ student 
writers. In their work on achievement motivation, McClelland et al. 
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(1953) illustrate how goal setting helps to create conditions necessary for 
improvement or achievement. Apparently, goals need to be concrete and 
within reach, and students need to see tfie results of their actions. The 
implication for teachers is that students should work toward a limited 
nunibey>f goals at a time and that progress toward specified goals should 
lK^?^gc^|[ed. 

A ,fif th^a^ is that writing improvement does not occur in isola-. 
Hon. M^^/L^^ing themes and arranging for some sort of evaluation 
prove in^^cient, because writing is related to speakings listening, r<ead- 
iug, and all the other avenues of communication available for processing 
information. Prewriting activities, revisions, sensory awareness experi- 
ences, responses to literature, development of sensitivity to self and 
others—thj^e and many other experiences, both in and out of the English 
classroom, f^ect a student s growth in writing. 
, The final^assumption is that we^have a reasonably clear understanding 
of procedures that u)iU permit effective formative evaluation, Charles 
Cooper (1975, p. 113) writes: ' 

I think a better scheme for writing instruction ... is one concerned 
with diagnosing what students are able to do and what problems 
they are having; arranging for writing often in many modes; cor- 
recting usage and syntactical and rhetorical deficiencies organicdt" 
ly by workmg with the students* own writing and not by preteach- 
mg rules; giving feedback and encouragement, as each of the 
students* efforts moves them toward better control of a particular 
mode of writing; and fiiudly assessing how much growth studerits 
have shown during the course, without comparing them invidious- 
ly tp each other and without expecting "mastery." The emphasis in 
this scheme is on diagrios'S, on formative response and evaluation 
to enhance the.ccmplex and highly individualistic process. . . . 

These six assumptions are important and have influenced the three eval- 
uative procedures I will be describing. 

Developing a Climate of Trust for Writing 

As a prerequisite to developing writers, teachers must develop a cli- 
mate of trust. Student writers need to develop trust in their own powers to 
communicate through writing; to explore feelings, ideas, and perceptions 
through writing; and to find security in transactions with their audience of 
teachers, peers, or others. 

As the teachers I have worked with have looked for ways to create trust 
through then- evaluatory comments, hvo authors have influenced them 
most. Vu-ginia Axline (1964) and Carl Rogers (1954 [with R. F. Pymond] 
and 1961) have developed ways of responding that teachers have success- 
fully adapted to student writing. The kinds of comments presented below 
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seem to be eiffective in creating a climate of trust. 

1 A teacher may ask for more information: Td like to know more 
about this."* '^What did the other kids do?** ''Have you seen 

on Channel 28 on Tuesday nights?" "Do you think 

there is a relation between this idea and die one John was talking 
about yesterday in class?" 

2 A teacher jmay mirror, reflect, or rephrase the student s ideas, per- 
ceptipnsy or feelings: '*You sound angry here/* "You really do find 

• school boring/' "You want to be both an artist and businessman/' 

3 A teacher may share with the student times when he>or she felt, 
thought, or behaved in a similar fashion: "I had problems with my 
parents, too. They insisted I be home by 11:00 p.m. on weekendsl'* 
"I stilPam lonely— perhaps all people feehthat way at times." 

As teachers have consistently a^id exclusively used these forms of cppfi- 
mentary, they have found that the dull, lifeless prose Ken Macrorie (1970) 
labels "Engfish" tends to decrease; students shed depersonalizing modes 
of expression, writing their own thoughts and feelings, becoming more 
authentic, dnd developing individual voices. In addition, students who are 
scared of writing begin to increase the length of their efforts, and those 
puny six-to-ten lines of timid prose become longer and more forceful. 

.Several of my graduate students used* these methods with their classes 
this fall. The following remarks are typical of their reactions: 

My kids spontaneously are writing pages in response to my 
que$tions-*all because I asked them a personal question. 

I never knew my students had so much going on in their lives. I 
seem to be following ISO different soap opera^s just because I've 
changed iny ways of responding. 

Not only do these responses serve to combat Engfish, to motivate stu- 
dents to write more, and to inspire more authentic v/riting, they also serve 
as reinforcement. C'^mments such as "No one else but you could have 
written it that way," and "Your figure of speech is just right, I think," 
indicate effective elements of writing and help students develop critical 
abilities. Furthermore, comments may also reinforce positive values. For 
example, in a theme describing happiness ahnost entirely in terms of 
material possessions, a stvdent had one sentence nientioning happiness as 
*Tiaving a wife and children to love and friends to share tlie years." His 
teacher reinforced that value by writing, "My family and friends seem to 
give my life its purpose and meaning." She had no need to criticize or 
moralize; the statement she made underscored a value seemingly lost 
among clars, clothes, travel, and houses. In addi'don, such conmients en- 
able teachers to ask the kinds of value clarification questions suggested by 
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Raths, Harmin, and Simon (1966). For exaInp^e, **ls it more important to 
you to .have a family and friends or to have three fantastic homes?" 

Whether papers are evaluiated through individualized goal setting, self- 
evaluation, or peer evaluation, the Atee^inds of commentary suggested 
above are appropriate and necessary to create a climate of trust. 



rndivrdiialized doat^ettntg ' 

Description , 

Individualized goal setting is carried out by the teacher, utilizing the* 
kinds of comment detailed in the previoas section* Guidelines for individ- 
ualized goal setting oUo w. 

1 Decide how you are going to respond: written comments, tape^ 
recorded comments, a rating scale, or personal conference. (Cole- 
man [1972] contpaxed marginal and terminal written commentary 
with aiidio-taped remarks, finding that black students and students 
with low pretest scores responded better to the taped comments 
than the white students. Classes using taped responses developed a 
iftiore positive attitude toward writing. Bata [1972] discovered no 
significant differences among three classes of junior college fresh- 
man papers evaluated in three different v)ays [fitarginal comnients 
vs. terminal comments vs. a mixture]. Stanton [1973] compared 
groups receiving feedback in the form of written commentary^ a 
checklist, teachi^r instruction, and questions and feedback, finding 
no significant differences although a checklist helped teachers be^ 
more reliable. Maize [1952] discovered that, when an instructor 
worked with college-level freshmen as they wrote in class and met 
in peer groups, evaluation was more effective than when an instruc- 
tor corrected papers outside class. Wormsbecker s [1955] research 
showed no significant differences among the writing samples col- 
lected from three different groups who received either overall im- 
provement suggestions, a split grade [form over content], or a single 
suggestion for improvement.) 

2 Read the paper and, where the motivation is genuine and spontane- 
ous, use commentary for developing a trusting environment. 

3 When you have read the paper, offer one positive comment, either 
genei'aljpr specific. 

4^ Establish a goal for the student to work toward, stating it in a posi- 
tive way: not, "Your paper is a disaster because it lacks organiza- 
tion;' but, "For your next paper write as vehemently, but after you 
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have sounded off, read your draft and revise, putting all your 
thoughts on one idea in the same paragraph." (Some students may 
. have more tlian one goal.) Encourage students to experiment and, 
take^ risks. 

5 ; Evaluate the student's next paper accutding to the goal(s) previous- 

ly prescribed. Do not prescribe additional goab until the student is 
able to handle ones already given. (Stevens [1973], in a ten-week 
period, discovered no significant differences between a group that 
received only negative comments and one that received only posi- 
tive remarks although students receiving positive comments had 
more^ositive attitudes toward writing. Groff [1975], in his review of 
research concerning the evaluation of younger children's writing, 
found that negative criticism seemed to have a p(|sitive effect, parti- 
cularly on mechanics. Buxton [1958] presented some evidence that 
writing o£ college freshmen improved more when it was thoroughly 
marked than when a few general suggestions were offered. Spjiroed- 
er [1973] found that corrective feedback produced more writing 
improvement than only positive feedback in composition work With 
fourth graders, Arnold's study [1964] compared students writing 
frequently with little evaluation with others receiving extensive 
commentary with still others who received a mixture; no significant^ 
differences. Although mixed, research does seem to indicate that 
setting goals for improvement is beneficial.) 

6 Every three to four weeksj^ depending on how much writing is done, 
have students revise a paper for a more thorough evaluation. (Un- 
derwood [1968] found that .grades used with marginal comments 
improved mechanics, but content improved without grades or mar- 

. ginal comments when revisions were require4^) 



Because the teacher knows each student, goals may be tailored, in a 
diagnostic-prescriptive fashion, to meet individual needs. A goal may be 
as specific as "Spell tomorrow, occasion^ and recommend correctly from 
now on," or as general as "Develop your own voice; your writing should 
sound as if you and no one else were writing." Sttidents feel a sense of 
self-worth and esteem as they progress at their own speed in their own 
idiosjjncratic fashion, with direction when needed. By limiting attention 
to a few goals at a time, the student is better able to concentrate on the 
content of the communication while the teacher does not have to spend 
an inordinate amount of time on each paper. 
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Advantages and Disadvantages 

Individualized goal setting, of the three approaches the most eflFective 
in creating a climate of trust, proves most advantageous at'the beginning 
of the school year when students and teacher are new to each other. It 
provides an opportunity for a teacher to become acquainted with stu- 
dents, to develop m accepting 'atmosphere, and' to assess writing 
strengths and weaknesses. Many teachers and students feelmost comfort- 
able with the highly-structured individualized goal setting because the 
teacher stays in control, diagnosing and prescribing work for individual 
students. Another advantage of individualized goal setting results from 
tapping the knowledge, awareness, and writing experience of the teacher. 
There are times when a teacher's perceptions and suggestions may prove 
fruitful and economical as a student works through a revision or toward 
specific goals on a week-to-week basis. 

On the other hand, there is at least one disadvantage to individualized 
joal setting. When a teacher is the exclusive audience for writing, slbdents 
ibecome dependent upon the teacher, an authoritarian figure who bestows 
approval or disapproval. Every time I have a new group of graduate stu- 
dents, many of whom haye become addicted to having their writing ana- 
lyzed and labeled by sdme "expert," we must break that addiction. Writ- 
ers must realize how their writing affects peers and learn to depend more 
upon their own powers of judgment. 

Teachers who have experimented with the three approaches to evalua- 
tion have found individuali[zed goal setting most helpful with those stu- 
dents who require more direction and guidance, at the beginning of the 
year, and at times when those engaged in peer or self-evaluation seem to 
need help in perceiving new possibilities for experimentation. 



Self*Evaluation 
Description 

In self-evaluation, students comment on their own writing and establish 
their own goals for risk-taking and improvement. Many teachers have 
found this sort of procedure helpful to use early in the school year be- 
cause it leads the student ^toward greater self-reliance and independence. 
Early in the term, students evaluate their own papers and then turn them 
in for a modified individualized goal setting evaluation, with the teacher 
conmenting upon the evaluation written by the student. 

The following questions form the basis for self-evaluation procedures 
throughout the year: 
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1 How much time did you spend on this paper? 

2 (Af t«r the first evaluation) What did you try to improve, or experi- 
ment with, on this paper? How successful were you? If you have 
questions about what you were trying to do; .what are tfiey? 

* 3 What are the strengths of your paper? Place a squiggly line beside 
those passages you feel are very good. 

4 What are the w^Jcnes^es, if any, of your paper] Place an X beside 
passages you would like your teacher to correct or revise. Place an X 
over any punctuation, spelling, usage, etc., where you need help or 
clarification. 

5 What one thing will you do to improve your next piece of writing? 
Or what kind of experimentation in writing would you like to try? If 
you would like some information related to what you want to do, 

" write down your questions. 

6 (Optional) What grade would you give yourself on this composi- 
tion? Justify it. . 

Because students tire of the same questions, teachers need to vary them 
from week to week, dd^ing questions related to the current work of. the 
class. 

The importance of self-evalifation may be revealed through an analysis 
of the questions themselves and of the relations between the questions 
and the assumptions presented at the beginning of this chapter. r ♦ 

By asking a student to reveal .the amount of time spent on a composi- 
tion, the teacher is alluding to the fact that often writing is a long, com- 
plex» and agonizing process, one that sometimes does not flow rapidly but 
stumbles about awkwardly. To make this question more meaningful, the 
teacher can share in class some of the letters or descriptions of thexjreative 
process as put forth by established writers. Flaubert^ Melville, Miller 
(1964), and others have described their struggles to say something ^'right"; 
Nin (1968), Miller, Forster; Lowes, and others talk about the unconscious 
prewriting that occurs; and still others portray the times when their writ- 
ing flowed rapidly in a mystical sort of v;ay. As students become more 
aware of the creative process, this particular question can be changed to 
ask for information about their processes in writing a particular composi- 
'tion. Soon, revealing information comes forth: 

I read two books on the subject, beconung very excited, but when 
I started writing, I didn't know how to start. I must have ripped up 
twenty sheets with various introductory paragraphs. Next I tried 
outliauig— f our outlines later I was still dissatisfied. So, because the 
time was getting short and I had already spent thirty-five hours on 
this darned paper, I began writing, wrote for six hours, and typed 
it up. The stuff goes in circles and never gets anywhere. I am disap- 
pointed. It is a flop—a complete disaster. 
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I thought a lot about my paper, even dreanu ^ one night. 

When I sat down to write it early this morning, • ^. all there. My 
mind must have been working on it, organizing it, during the week. 
Everything came out all right, and I am proud of the paper- 
except that J feel a little guilty because the actual writing went as 
smoothly and rapidly and I know others in the class spent hours. 

^^, The teacher, as this kind of information is shared, can help students 
cfeal with their own creative processes, helping them to recognize that at 
umes all writers write in circles. And as students analyze their own crea- 
iiive processes and compare them with others, they begin to recognize 
/various strategies they might try. 

' The third question, asking a student to identify the strengths of his or 
/ her paper, is important for thr6e reasons. First, according to Jourad 
/ (1963), Maslow (1962 and 1971), Rogers (1954 [with R. F. Dymond] and 
f 1961), and others, most people have difficulty praising themselves and 
accepting praise from others. "I'm O.K." is hard to say and '*You're O^K." 
is difficult to accept. These difficulties have developed through condition- 
ing, asking students to identify strengths of their papers is one way to 
combat this cultural conditioning. Second, many students have never con- 
sidered the possibility that there couW be something good about their 
writing, for > ears the> have been churning out the stuff because they were 
obliged to do so. To have to point out something of which they are proud 
motivates students to write from a different perspective. In my experi- 
ence and in that of my fellow teachers, ^/e have found that this one ques- 
tion iiiutivates students to work on passages until they are "just right." The 
third reason for the question is that writers must ev entually become inde- 
pendent, able to identify passages that gracefully communicate meaning 
^md intention, writers must become their awn editors and form their own 
aHthetic judgments. 

lln^^fourth question also refers to the editorial process and to aesthetic 
judgnietit because it asks students to locate weak passages. By asking stu- 
dents iu dbs^is, teachers indicate tliat they expect students to have prob- 
lems in writin^L it is acceptable to have them. And when a student indi- 
cates w here he oV,^he w ants help and red-pen marks, he or she remains in 
control of the evaiviation process because red marks are applied only 
upon invitation. \s Stnith (1975) points out, comprehension and learning 
occur when the students* expressed (juestions and needs are addressed. 

Self -evaluation is also i.elpful during various stages of revision. Beach 
(1976) asked tw ent> -six prt.^erv ice English teachers to write a draft, tape- 
record their self evaluations,' revise, tape-record, revise and tape-record 
until the> were satisfied B> S:nal>zing their taped comments and the 
chan);es the> made, he found tha' fifteen of the^e teachers were nonrevis- 
ers, concentrating on details, labeling them (frag, awk, etc.), and making 
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superficial changes as they ware "smoothing out," "polishing," and "tying 
together." The extensive revisers attained an aesthetic distance the nonre- 
visers lacked, for they looked at their writing in holistic, general ways; 
seeing how the parts fit together as they developed a sense of an overall 
structure. Once they saw a structure emerge, they worked with their 
material until the revision matched the conceptual, structural vision. 

When we ask students to request help where needed, we discover stu- 
dents* perceptions of their writing. Students who request help only for 
mechanical errors, not noticing a need for restructuring, may need help in 
revision strategies; they may not perceive the need to reconceptualize the 
structure and to relate the parts to the whole. 

The fifth question is also designed to give a student more control over 
his or her own progress in writing. Asking.a student to establish a goal for 
experimentation or improvement strengthens risk-taking capacities, 
decision-making capabilities, and goal-setting processes. Furthermore, 
because the writing process is so complex, perhaps the student knows 
best where he or she needs to improve or experiment (conditions under 
which the writing is done; prewriting strategies; original drafts; revision 
tactics; kinds of discourse; styles). One student, working full time in addi- 
tion to attending high school and living in a large famUy, believed that her 
biggest problem was that she could find no time or place to be alone to 
think and prepare a first draft. Several weeks of experimentation helped: 
she woke up at 3:00 a.m., locked herself in the bathroom, and wrote from 
3:00-5:00 a.m. In another instance, a college student, psychologically un- 
able to write poetry or short stories, revealed that unless she stuck to criti- 
cal, expository essays, painful memories of three deaths from cancer in 
her family surfaced and paralyzed her. Once she realized she was in a 
climate of trust and acceptance, she set up goals: to write about those 
deaths and deal with the issues. About two months later she was writing 
freely in a variety of modes. Only when a student is free to decide upon 
his or her own goals for improvement or experimentation, wUl he or she 
be able to explore those elements which -impede progress— elements 
which a teacher or^>peers may know notliing about. 

Obviously related to the fourth and fifth questions, theseco id question 
places the responsibOity upon the student to follow through on the deci- 
sions made on the last self-evaluation. Again, researchers in achievement 
motivation emphasize the importance of goal setting and evaluation: 

The more an individual commits himself to achieving concrete 
goals in life related to the newly formed motive, the more the mo- 
tive is likely to influence his future thoughts and actions. 
The more an individual keeps a record of his progress toward 
achieving goals to which he is committed; the more the newly 
formed motive is likely to influence his future thoughts and actions. 
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C'langes in motives are more likely to occur in an interpersonal ' 
atmospherfj in which the individual feels warmly but honestly sup- 
ported and respected by others as a person capable of guiding and 
directing his own future behavior. . . . 

Changes in motives are more likeo occur the more the setting 
dramatizes the importance of self -'tudy. . . . (deChanns 1968) 

Question six, optional, asks the student to place a grade upon the paper. 
If a school system insists that grades be given, I feel that it is oppressive 
for teachers to label and grade students and their work; students should 
have the power to grade andvlabel themselves in such a way that they 
have to sift through a numberof factors, balance them, and decide upon a 
' grade. In my experience I find that my assessment and that of the students 
correspond in 90? of the cases, and the 10« discrepancy provides a start- 
ing point for discussion in individual conferences. 
' Teachers and students have found rating scales helpful in providing 
structure for self-evaluation. (Refer to Charles Cooper s chapter for a dis- 
cussion of some of the available scales; some of the ideas presented in the 
other chapters may also be adapted and introduced as self -evaluation 
strategies.) . 

*^ . ^ Rationale 

Self-evaluation procedures help students assume responsibility for as- 
sessing their writing. As one teacher said, "For the first time my students 
are seeing beyond the stage of just writing a paper, handing it in, a;id 
forgetting about it. They aa;eiean) mg toj at their papers through criti- 
.cal eyes, becoming more aware of areas in which they can improve their 
writing on their own." Perhaps self*evaluation procedures are essential for 
. helping students become their own editors, knowing what needs revision 
'and knowing how to go about that revision. Such procedures also encout- 
^ age students to formulate questions, helping the teacher to know what is 
)^ needed when it is needed. 

Not only is this approach educationally sound, but it also relates to the 
developnient 6f a fully-functioning personality. Rogers (1954 [with R. F. 
Dymond], 1961, and 1962) states that one of the three characteristics of a 
creative personality is an inner locus of evaluation, and students need 
many opportunities in school to develop that inner locus. In their work 
with achievement motivation, McClelland et al. (1953), finding that indi- 
vidualized goal setting and self-cvaluation bring about achievement, have 
developed-theoretical frameworks from which others, such as Otto (1968), 
Alschulcr (1973), and Alschuler, Tabor, and Mclntyre (1970), have 
evolved specific nianuals and training programs based upon goal setting 
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and self-evaluation. Fromm (1947 and 1966) illustrates how people be- 
come dependentupon authority figures, failing to outgrow their need for 
them; h^points out clearly that people need to become more responsible 
for charting tl^eir own goals and evaluating their own efforts. Ekstein and 
Motto.(1969)'eontend that children initially work to please their teachers; 
yet to mature as learners, they must begin to decide what they are going 
to learn, how to go about that learning process, and how to evaluate their 
own progress; motivation and evaluation must become internalized. Self- 
_ assertion training programs relate to thii need for people to become self- 
evaluative and then to act in accord with their own evaluations. As one 
^ , reads the works of educational and psychological researchers, theorists, 
and practitioners, the cry for self-evaluation procedures sounds forth like 
a clarion. . 

Advantage's and Disadvantages 

Unlike peer 'evaluation, self-evaluation need not consume large 
amounts of class time; unlike individualized goal setting,. self-evaluation ^ 
need not consume the teachers after-school hours. Self-evaluation can 
occur in class within five t(>. ten minutes, although, if so desired, it can be 
used in conjunction with one of the other modes of evaluation. 

Of all three forms of evaluation, self-evaluation allows students the' 
most freedom to decide their individual courses of action, developing 
editing skills in the process. It promotes self-reliance, independence, au- 
tonomy, and creativity. 

The primary disadvantage results from cultural mores and condition- 
ing. Teachers are supposed to be authoritarian experts while students, 
supposedly knowing little, depend upon the mandates of those in power. 
And, indeed, teachers tend to become uncomfortable when they forego 
some of their power, control, and authority; they feel as if they are "not 
doing their job," "slacking their efforts," **not giving students what they 
deservf? and what taxes are paid for." Sometimes if only self-evaluation 
procedures are 'used for more than two weeks, students begin to experi- 
ence existential anxiety, feeling uncomfortable with freedom and wanting 
to escape from it. They tend to panic, begging teachers^ to assume the 
responsibility and give them grades. A number of parents, in one case, 
even called the school to demand that teachers not abdicate thejrjrespon- 
sibility. 

Consequently, if a teacher wants to- make^ extensive use of self- ' 
evaluation procedures, he or she needs to have the interpersonal skills or 
counseling techniques to work through these conflicts and to help students 
and parents deal with the anxiety generated. In some cases, a guidance 
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counselor has worked with teachers and students until all are comfort- 
able. However, it should be noted that, used intermittently of simultane- 
ously with other evaluation procedures, self-evaluation causes few, if any, 
problems. Problems emerge only when this approach is used extensively 
by itself. * ^ 



Peer Evaluation 

Description 

The third approach to,evaluation involves peers who meet in small sup- 
port groups to respond to each other's writing. However, before peer 
evaluation begins, a climate for sharing must be developed, during which 
time individualized goal setting and §elf-evaluation work well. The inter- 
personal skills needed for peer evaluation can also be developed at this 
time. A suggested procedure follows. 

1 First stage. Students work in pairs on tasks that take fifteen to tv*'en- 
ty minutes to complete. (These tasks do not have to be related to 
writing or even English.) "Work with someone you do not know" 
and "Work with someone you have not worked with before" are 
criteriajor selection of partners. 
2r Second stage. Students work in groups of four on tasks of fifteen to 
twenty minutes. Groups change with each task. A group of students 
working in front of the rest of the class can be used to model and 
shape desired group behavior. Roles (recorder, discussion leader, 
etc.) may be assigned. When all students seem accepted in these 
groups, the class progresses to the next stage. 

3 Third stage. The teacher assigns students to groups for sustained 
^>:jr projects. Evaluation procedures may be used to focus on group dy- 

'"^^ , namics and interpersonal skills. 

4 Fourth stage. Students select their own groups for sustained projects 
or support. 

5 Whenever necessary or appropriate, a class may return to a prior 
form of group work. 

Highly-stnjctured forms (rating scales) may be used as soon as students 
are comfortable in the first stage; structure is also needed in the second 
stage. However, the desired growth in writing seems to occur when stu- 
dents work with the same group for an extended period and when there is 
less structure. (For a thorough discussion of group processes, refer to Ya- 
lom 1975. For a more practical approach, refer to Stanford and Stanford 
1969, or Sax and Hollander 1972.) 
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During peer ey^Iuation, 'teachers need to provide mahy opportunities^ 
for student$,to write immediately after the presentation/of ^ stimulus lilce^ 

. ** nonverbal movies, sensory awareness activities, or inteq^rsonal encoun- 
ters. Upon completion (not the next day), students read their papers 
aloud. (After the oral sharing, the papers are not read by anyone else 

. unless students have time to revise and proofread.) Through comments 
and questions, teachers focus on the differences in the responses to. the 
same stimulus. 

As studients share and focus on unique qualities of each paper, they 
begin to appreciate differences in approach^ content, organization, flavor, 
and wording. Then students come to expect differences, and this expecta- 
tion frees students to say or write their "own things" in their own ways. 

The climate for sharing comes when appreciation and expectation of 
differences are well established. Then small groups, instead of die large 
group, may be used iFor oral shariij^of impromptu writing, and peer eval- 
uation may begin with revisions of work that has been orally shared. 

To give direction to peer evaluation, teachers distribute tlie following 
questions to the small groups: 

1 Identify the best section of the composition and describe what^ 
makes it effective. 

2 Identify a sentence, a group of sentences, or a paragraph that needs 
revision, and revise it as a group, writing the final version on the 
back of the paper. 

3 Identify one (or two) things the writer can do to improve his or her 
_ next piece of writing. Write these jgoals on the first page at the top. 

4 (After the first evaluation, the following question should come first.) 
What were the goals the writer was working on? Were they 
reached? If not, identify those passages that need improvement and 

" as a group revise those sections, writing final versions on the back of 
the paper. If revisions are necessary, set up the same goals for the 
next paper and delete question 3. 

As with the questions for self-evaluation, teachers have found it helpful to 
vary them by deleting one of the questions and adding others related to 
aspects of composition dealt with in cla^s. 

As a class begins to engage in peer evaluation, various rating scales can 
provide useful structure. (See the Cooper and Lloyd-Jones chapters.) 
Teachers often begin peer evaluation by working through a rating scale 
with the entire class and sample papers. When students have the knack of 
using a scale, they break into small groups to have a go at it. 

Students in high school have effectively used the rating procedures for 
expository writing developed by Diederich (1^4). Sager (1973) found 
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that sixth-grade students could use the rating scale she developed to eval- 
uate and improve their writing. Although not dealing with rating scales, 
Lagana s research (1972) concluded that after specific goals for writing 
improvement had been established, peer evaluation was as effective as 
traditional teacher evaluation over a fifteen-week period. 

Combining individualized learning activities and peer evaluation of 
compositions, Lagana's study centered on the development of a modpl 
for working with expository writingTFor each composition assigned, each 
peer group selected its owu topic and decided upon a writing objective 
from teacher-prepared lists. Individualized learning activities for each 
objective were available for students who wanted to worlc with tf^em. At 
the end of the semester, the writing of the experimental group of thirty 
tenth-grade students (who had written ten compositions) and the Writing 
of Ae control group (who had written sik compositions) were compared. 
The results: peer evaluation was as effective as teacher evaluation; peer 
/4^aIuation reduced the teachers onerous ^burden of correcting papers 
after school and enabled students to write more frequently; individual- 
ized activities helped students progress at their own rate; peer groups 
provided more immediate feedback than diov the teacher. 

TheTesults of these studies suggest that a, progression may be estab- 
lished for peer evahiation. First, peer evaluation Vi ay center on the rating 
scales developed through various research proji^V Next, students begin 
to assume more control by having peer groups select their own topics and 
goals for writing improvement from prepared lisw^. Finally, students may 
have enough experience and sophistication to useWily the questions sug- 
, gested in this chapter. Such a progression goes tVom highly structured 
experiences to less structured ones. \a 

Rationale 

Peer evaluation offers each student an opportunity t<^^dbserve how his 
or her writing affects others. Because the most significantN?thers in a teen- 
ager's life are peers, peer evahiation provides a kind of 'motivation not 
available in the other approaches to evaluation I have described. As trust 
and support grow in these small groups, students begin writing for peers, 
developing a sense of audience, becoming aware of their own, voices, and 
using their voices to produce certain effects in others. This cognizance of 
audience and voice may develop early: when my older son was in third 
through fifth grades, he regularly "wrote books" and shared them with the 
same group of peers. He knew John would respond best to his science 
fiction stories, that Peter would appreciate his books of jokes and riddles, 
and that Karl would like his plays on words and experimentation. 
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Research* studies dealing with peer groups and evaluation of writing 
(Lagana 1972; Maize 1952; Sutton and Allen 1964; Ford 1973; Pierson 
1967; and Sager 1973) indicate that improvement in theme->vriting ability 
f and grammar usage, when small groups of students engage in peer evalu* 
atioii) may equal or even exceed the improvement that occurs under eval- 
uation procedures carried out by the teacher. Lagana, jn particular, dis- 
covered that his experimental group improved more than the control 
group in organization, critical thinking, and sentence revision; the control 
group showed greater improvement in conventions. Ford found that the 
college freshmen in the experimental group showed significantly higher 
gains in both grammar and composition ability. 

In addition, peer evaluation helps students to check their perceptions of 
reality and to correct distortions. For instance, last year some inner-city 
. children working in a peer evaluation group were writing about snakes, 
and as they compared their descriptions of snakes, they found that one 
y boy's snake had three eyes, another boy's had four legs, and a girl's slept 
in the summer and went ice-skating in the winter. After much merry dis- 
cussion, on their part, I sent them to the library to do some reading, and 
the librarian reported that they helped each other check out their percep- 
tions, accommodating them to reality. On a more sophisticated level, stu- 
dents who believe that a particular passage conveys precisely what they 
mean often have to face the reality that none of their peers can under- 
stand the garbled expression. 

Peer evaluation also strengthens the interpersonal skills needed for col- 
laboration and cooperation as students identify strong and weak passages 
and revise ineffective ones, as they set goals for each other, and as they 
encourage risk-taking Tjehaviors in writing. These evaluation procedures 
accommodate the needs McClelland et al. (1953) have identified in their 
work on achievement motivation. After basic needs are met, needs for 

^ affiliation, power, and achievement must be satisfied to produce growth. 

Seemingly, achievement is dependent upon fulfiUment of the needs for 
affiliation and power. In their work with urban education, Weinstein and 
Fantini (1970) have identified three similar concerns: (1) **Concem about 
self-image'; (2) "Concern about disconnectedness, a wish to establish a 
connection with others or with society, at large, to know where one fits in 
the scheme of things"; (3) "Concern about control over one's life." Small 
peer groups help students develop a seu^e of self and relationship to oth- 
ers: "Who am I?" and "How do I fit ixiT are the questions raised as a 
person works through affiliation needs in a small group and is accepted as 
an integral part of the group. When peers have regular opportunities to 
share their writing and to take part in evaluation procedures, they exercise 
power or control over decisions that affect their own work. Furthermore, 
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as the dynamics of small-group work evolve, peers develop a sense of 
group inclusion, acceptance, support, trust, reality-testing, and coUabora- 
tipn. 

^Advantages and Disadvantages 

/■nn. , 

The edu(»tiobal value of group work, the personal-growth potential, 
and the development of interpersonal skills make peer evaluation highly 
desirable for classroom use. Students seem to learn how to handle written 
language more effectively as they read what peers have written; peer 
models seem to be more efficacious than models from established writers. 
As peers collaborate to revise passages, they engage in taxing woric, moti* 
vating them to diagnose what is wrong, prescribe what is needed, and 
then collectively struggle through' revision procedures. Editing and revis- 
ing become more palatable as group efforts, and, when everyone in the 
group is stuck, the "teachable moment" comes forth. ^ 

Another advantage is that the teacher is relieved of spending coundess 
hours on grading papers. Interestingly, all of the research studies on peer 
evaluation emphasize this point (Lagana 1972; Maize 1952; Sutton and 
AUen 1964; Ford 1973; Pierson 1967; and Sager 197^). Through the use of 
peer evaluation procedures, students are able to write more frequendy 
and to receive more immediate feedback, and teachers have more time 
for individualized instruction and for conferences with students. 

Yet there are disadvantages to peer evaluation. Group processes take 
time; groups that function well tend to spejjd half their time on process 
and holf on task. If a curriculum has vast amounts of materia! to cover and 
if teachers feel compelled to cover everything, frusjbration is bound to set 
in unless teachers and students want to spend time on grpup processes. 
Interpersonal skills take time to develop, and many teachers may need the 
security of an inservice course or a summer school course in Woup work 
before they will feel sufficiently competent to use group pWedures. 
(However, at times a school counselor with group skills has worked with a 
class and teacher until interpersonal skills were strengthened.) 

Another problem that has emerged is that some teachers do not trust 
group processes. In one school, teachers working with peer evaluation 
were first reading the papers, tallying the mistakes, and developing class 
exercises to deal with the errors. After the group work, teachers read the 
evaluations and papers (again!), discovering that some peers were cor- 
recting passages with no mistakes. So teachers were correcting the mis- 
corrections, spending an inordinate amount of time and becoming frus- 
trated. Because peers obviously lack the sophistication of the teacher, 
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, they will misperceive some passages, but these distortions can be looked 
at diagnostically, since they illuminate where the students are and what 
Jhey think is good and bad, effective and ineffective, correct and incor- 
rect.Students* misperceptions can help the teacher determine where to 
begin instruction. Moreover, a teacher must allow students to have free- 
dom to make mistakes and to develop confidence in their own percep- 
tions knd decisions. If a teacher is able to f acilitate such group work, then 
peer evaluation has untapped potential for the improvement of student 
writing. It should bemused much more extensively. 



Individualized goal setting, self-evaluation, and peer evaluation have 
much to contribute to formative evaluation of writing in the classroom 
because the individual shidients become increasingly responsible for the 
direction and evaluation of their own gro^vth in writing. Used initially, 
individualized goal setting develops a climate of trust and acceptance as a 
teacher gets to know students and their writing strengtfasmd weaknesses. 
Later in the year, individualized goal setting helps students to see beyond 
their own horizons and gain a broader perspective of the possibilities in 
writing. Self-evaluation strengthens students* editing^LjMties, giving thtoi 
control over decisions that affect their own writing growth as they learn to 
trust their own criteria of good writing. Peer evaluation helps-student 
writers find their voices, develop a sense of audience, and experiment 
with revision strategies. 

After introducing the throe evaluation procedures, teachers may want 
to divide the year into blocks of two, three, or four weeks during which 
one-third of a class works closely with the teacher on individualized goal 
setting, another third uses self-evaluation strategies, and the last third en- 
gages in peer evaluation. When the time is up, students change to another 
kind of discourse and another approach to evaluation. 

While the above is going on, teachers may want to introduce a variety 
of ways of describing/responding/evaluating and have students experi- 
ment with these as they compose, revise, and evaluate their own writing. 
This book should provide some ideas that can be adapted for students to 
use as they engage in peer and self-evaluation. In an ideal situation, stu- 
dents should have an acquaintance with a large repertoire of evaluation 
techniques and approaches and should be able to decide which one of 
these, would prove most helpful for each paper in its various stages. 
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